I have been able to get Astronomer running and some basic DAGs with Python operators are also running successfully.
I am having issues running the Databricks operator.
In my DAG .py file, I specify the following line to try an import it:
When I open Airflow, however, I get this error:
According to the blog post about the Databricks operator, it should be integrated in Airflow 1.9.0 which was released on December 15, 2017 according to airflow github.
Is Astronomer using a version earlier than 1.9.0?
Is there something else I need to do in order to ensure that Airflow on astronomer will be able to use the databricks operator?