I am creating dynamic DAGs using Variables in Airflow.
One of my DAGs update the the variable and then trigger a DAG. The triggered DAG fetches the variable and create tasks out of it. The problem arises when that Variable is again while my triggered DAG is still running.
How can I solve this?
Hi @brihati; yeah this is a tough one, unfortunately no clear workarounds come to me off the top of my head.
Were you using the instructions here?
https://www.astronomer.io/guides/dynamically-generating-dags/
Can you prevent other users on your team from changing that variable?