Running airflow locally with CeleryExecutor instead of LocalExecutor?

#1

Is this possible with astro cli?

0 Likes

#2

Hi @edbizarro! With Airflow on Astronomer, you’ll only be able to run the CeleryExecutor on a remote deployment, not locally.

We actually used to have that functionality in earlier versions, but it caused a variety of issues and was overly taxing on people’s machines.

If you’re running vanilla Airflow, you should be able to run the Celery Executor locally, but we can’t speak to best practices there or exactly what you’d need to do so successfully.

0 Likes

#3

Hi @paola thanks, we need to run the CeleryExecutor locally for tests purposes before deploy to remote, but we’ve achieve that with https://github.com/puckel/docker-airflow project.

Thanks!

1 Like