Is there any way to get Airflow DAG logs NOT from Elasticsearch

Astronomer Astronomer Software (Enterprise)
1

Hello,

I wonder if there is any way to configure Astronomer’s provisioned Airflow to get DAG logs not from Elasticsearch?
We don’t want to provision bundled Elasticsearch + Kibana + Fluentd because:

  • they are k8s cluster resources hungry
  • your Helm chart doesn’t provide and option to provision Fluentd as Deployment instead of DaemonSet (we don’t want Fluentd to get scheduled on each and every node)

Thanks in advance!