Hi @paola, I just came across this thread recently and was about to add teamclairvoyant/airflow-maintenance-dags for as Airflow metadata db retention policy.
It’s been about 3 months since October 2022, has Astronomer implemented automatic Airflow metadata cleanup? Is this in production?
If it has been implemented, can you please point me to documentation and configuration to setup the retention policy? Also which version of Astronomer Runtime supports this feature.
Hey @ltu2023 Thanks for reaching out. While this is still on our roadmap and it’s very much our intent to solve for this problem, it’s still going to take some more time for us to get this out. I can’t promise an expected month quite yet. The Clairvoyant maintenance DAGs seem like a fair bet to me in the meantime.
Curious, what’s the primary driver for implementing this cleanup? It’d of course be a best-practice, but curious if you’re hitting a pain point that’s making this particularly relevant for your team.