Hi. I keep getting the already registered for DAG error in Airflow. Possible reason for this I think that I pass the value returned from task1 to other tasks as output, as in the code below.
Since there are 9 tasks in a dag and it is constantly triggered, my log records are growing a lot. I need suggestions for this error or for using output. Thanks in advance.
Dag’s working logic is to run task1 once and use the returned values in other tasks.
task1 = PythonOperator( task_id="exampletask", provide_context = True, python_callable=python_fonk1() ) task2 = PythonOperator( task_id="exampletask2", provide_context = True, op_args=[task1.output], python_callable=python_fonk2() )