I am trying to use S3KeySensor for event based triggering of dag. One of arguments to be passed to S3KeySensor is aws_conn_id. I am connecting with S3 using the below code snippet:
sts_client = boto3.client(‘sts’)
response = sts_client.assume_role(
RoleArn=role_arn,
RoleSessionName=session_name
)
temp_credentials = response[‘Credentials’]
s3_client = boto3.client(
“s3”,
aws_access_key_id=temp_credentials[“AccessKeyId”],
aws_secret_access_key=temp_credentials[“SecretAccessKey”],
aws_session_token=temp_credentials[“SessionToken”]
)
How can I set the aws_connection_id for this s3_client so that I can pass that conn id to S3KeySensor?
Or is there a way to direct S3KeySensor to the S3 bucket to connect to? I cannot use Airflow UI to setup connection
Thanks