How to use Google Cloud Storage List Operator and Google Cloud Storage To BigQuery Operator?

Airflow
1

is there a good example how to correctly combine the two operators GoogleCloudStorageListOperator and GoogleCloudStorageToBigQueryOperator?
I know that the list operator returns the GCS objects as XCom. But how can I use them in the next operator? Since ‘source_objects’ is a template field, I thought I could just use it, but I always get the error “Source URI must not contain the ‘,’ character: gs://xxxx/,”.

Cheers Johannes

2

Might be good to ask this in the #airflow-gcp channel in Airflow Slack - the Astronomer team is mostly focused these days on Airflow core and our product, don’t think anyone is using these operators.