Getting logs using KubernetesPodOperator

1

I am trying to use the KubernetesPodOperator on the Cloud version (Local Deployment). I keep getting an error when the task attempts to get the pod logs

*** Log file does not exist: /usr/local/airflow/logs/refresh_pmt_catalog_addresses_staging_v03/pull_order_addresses/2019-11-12T00:00:00+00:00/2.log
*** Fetching from: http://:8793/log/refresh_pmt_catalog_addresses_staging_v03/pull_order_addresses/2019-11-12T00:00:00+00:00/2.log
*** Failed to fetch log file from worker. Invalid URL 'http://:8793/log/refresh_pmt_catalog_addresses_staging_v03/pull_order_addresses/2019-11-12T00:00:00+00:00/2.log': No host supplied

It seems like the host is missing somehow. The task setup is

KubernetesPodOperator(
        task_id='pull_order_addresses',
        name='pull-order-address',
        image="my-image:latest",
        namespace='astronomer-cloud-my-deployment',
        arguments=["""echo Hello world!""],
        params=my_params,
        is_delete_pod_operator=True,
        in_cluster=True,
        get_logs=True,
        env_vars=my_vars
    )
2

I wonder if it’s the is_delete_operator=True maybe it’s deleting the pod before logs can be grabbed?

3

we’ve also seen similar errors where the worker pod runs out of memory and crashes (so not related to KupePodOp in anwway). Are you an astronomer customer? If so I can check your pods for OOM errors. you can submit a ticket at support.astronomer.io if you’d like us to take a look.