We are migrating the jobs from helix to airflow folder wise. One folder have 800 jobs and we cannot move all of them at once to airflow. I want to divide the jobs sub folder wise and execute them in airflow by holding other jobs in helix. Is there any better approach other than creating link jobs between helix and airflow ? Please suggest
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Another directories in the dags directory | 0 | 1636 | February 14, 2021 | |
Is Airflow good fit for this project? | 0 | 893 | May 18, 2023 | |
Feedback on my implementation | 5 | 2153 | December 18, 2020 | |
Want to go ahead with Airflow Production, need guidance on parameters. Completed POC | 2 | 1127 | April 26, 2023 | |
Airflow support to Mainframe Jobs | 0 | 2081 | May 14, 2021 |