Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Don't re-invent the wheel, use AirFlow :)


Not the grandparent, but Airflow is painfully slow and inefficient.

Our reinvented wheel using posgresql, rabbitmq and EC2 runners has ~10x better throughput and scales linearly with the number of pending tasks, whereas the airflow falls apart and fails to keep the runners fully occupied the moment you out any real load on it.


Does Airflow run in a browser?


If you mean it has an html based UI, yes.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: