Monitoring with datadog

We use datadog to monitor much of our infrastructure. Often a sidecar datadog agent is able to provide a statsd daemon to receive metrics and forward them on.

Is there a way to do similar with our astronomer cloud deployment? Could we add another container to our deployment?

The alternative I am planning to go with if there is not already a known better approach is to use a custom entrypoint script that will spawn a datadog agent in the background. Something along these lines:

However, I generally avoid running two processes in a single container and hope there is a good alternative.


1 Like

There is an official datadog integration for airflow:

I raised a support ticket to ask when this would be available for Astronomer and the reply (May 2020):

Unfortunately at this moment we do not have support for Datadog integration with Astronomer platform, but this is something we are looking to have in near future.

Perhaps with more interest they will raise the priority of this request.

Definitely still on our roadmap!

I have taken note of this request and adding it to our issue tracker!

1 Like

Hi there -

Is it possible to integrate yet?

Currently, it is in development and some Enterprise customers have already started testing it out.

If you are an Enterprise customer, please reach out to us from the support portal.

1 Like

Hi there - what’s the status of this? Is it available for all customers yet?

@Alan Any update here?

+1 on this topic. Would be really nice to see either a working config for the Airflow integration or a separate integration for Astronomer. If it’s already using statsd it seems like the metrics could be remapped per the Datadog Ariflow integration docs into the dogstatsd.

+1 This would be amazing to have as part of the cloud instances. The native logging can be very finicky

Support informed me that this is no longer on the road map for cloud instances, enterprise only…

I can confirm there is no plans for Astronomer Nebula. The integration is only available in Astronomer Software.