Hello ,
Webhdfs dags failing with Authentication failure issue.
Airflow version : 2.2.3
Error :
2022-01-11, 15:57:11 UTC] {client.py:38} ERROR - b'<html>\n<head>\n<meta http-equiv="Content-Type" content="text/html;charset=utf-8"/>\n<title>Error 401 Authentication required</title>\n</head>\n<body><h2>HTTP ERROR 401 Authentication required</h2>\n<table>\n<tr><th>URI:</th><td>/webhdfs/v1/</td></tr>\n<tr><th>STATUS:</th><td>401</td></tr>\n<tr><th>MESSAGE:</th><td>Authentication required</td></tr>\n<tr><th>SERVLET:</th><td>webservices-driver</td></tr>\n</table>\n\n</body>\n</html>\n'
[2022-01-11, 15:57:11 UTC] {webhdfs.py:91} INFO - Read operation on namenode {hostname} failed with error: Authentication failure. Check your credentials.
[2022-01-11, 15:57:11 UTC] {taskinstance.py:717} DEBUG - Refreshing TaskInstance <TaskInstance: Billingplatform_daily_sanpshots.pricing_object.download_object_Pricing manual__2022-01-11T15:21:35.364322+00:00 [running]> from DB
[2022-01-11, 15:57:11 UTC] {webhdfs.py:91} INFO - Read operation on namenode {hostname} failed with error: Authentication failure. Check your credentials.
I installed the kerberos, hdfs, snakebite package but still having the same issue. Can anyone help here