Report a warning - similar to on_failure_callback, but without failure

Airflow
1

Hi!

Is there any way of sending a message for a “warning”, similar to on_success/failure_callback? I have a dag that will keep on running even if there are missing records for a date. I don’t want it to fail, but I would like to get notified when a missing record is found, without having to stop the dag.

Is there any way of making a “pinpoint-warning” for the dag to “pick-up”/report? Or do I have to rearrange the dag so a separate task checks if there are any warnings and go from there?

I tried to formulate my question in an understandable manner, I hope it’s not too unclear.
Thanks!

2

Hi Ellen, welcome to the forum :slightly_smiling_face:

One idea: add a task that just assesses data quality, and sends you an email or slack message if it fails, along with any info that you collected.