Hi All,
in Airflow 2.4.0 - newly setup system - the logs are not shown in the Airflow UI. Kubernetes executor is used for running the tasks.
The pod starts and immediately stops without any logs. the job is marked as success.
Any clues?
logs and configuration are attached below. thanks.
*** Unable to read remote log from gs://ph-airflow-/logs/dag_id=composer_sample_dag/run_id=manual__2022-10-14T11:07:16.322047+00:00/task_id=print_dag_run_conf/attempt=1.log
*** 404 GET https://storage.googleapis.com/download/storage/v1/b/ph-airflow-/o/logs%2Fdag_id%3Dcomposer_sample_dag%2Frun_id%3Dmanual__2022-10-14T11%3A07%3A16.322047%2B00%3A00%2Ftask_id%3Dprint_dag_run_conf%2Fattempt%3D1.log?alt=media: No such object: ph-airflow/logs/dag_id=composer_sample_dag/run_id=manual__2022-10-14T11:07:16.322047+00:00/task_id=print_dag_run_conf/attempt=1.log: ('Request failed with status code', 404, 'Expected one of', <HTTPStatus.OK: 200>, <HTTPStatus.PARTIAL_CONTENT: 206>)
*** Trying to get logs (last 100 lines) from worker pod composersampledagprintdagrunco-da51b053d9e041c8b48a2a4b45e5b4ea ***
*** Unable to fetch logs from worker pod composersampledagprintdagrunco-da51b053d9e041c8b48a2a4b45e5b4ea ***
configuration;
[logging]
base_log_folder = /opt/airflow/logs
remote_logging = True
remote_log_conn_id =my_gcp
google_key_path =
remote_base_log_folder =gs://ph-airflow-sit/logs
encrypt_s3_logs = False
logging_level = INFO
celery_logging_level =
fab_logging_level = WARNING
logging_config_class =
colored_console_log = True