Airflow 1.10.10 introduces a feature that allows users to sync Airflow Connections + Variables to a secret backend, e.g. AWS Secret Manager, AWS Parameter Store, Hashicorp vault etc.
For users that continue setting connections in the Airflow UI or via Environment Variables, it’s worth noting the order in which those connection details (potentially distinct from one another) take precedence:
- Secret’s Backend (From Airflow 1.10.10 and if the Secret’s Backend is defined)
- Environment Variable
- Airflow UI/Metadata Database