Right now I give S3 connection with access key and secret key in the connection variable .
I want to connect to S3 without using those access key/Secret key but use IAM Roles
Is it possible?
Right now I give S3 connection with access key and secret key in the connection variable .
I want to connect to S3 without using those access key/Secret key but use IAM Roles
Is it possible?
It is possible if your running Airflow on an EC2 instance. The S3Hook will inherit the role of the instance if you leave the creds blank in your Airflow connection.
Thanks for your reply . I understand that but the Airflow is running on the Docker , How will I test using IAM Role?
I’m not sure your setup. Are you using ECS? Does this help?
https://docs.aws.amazon.com/AmazonECS/latest/developerguide/task-iam-roles.html
We don’t use AWS to host our platform, so I haven’t tried this.
Ok I have to try out using roles