Accessing adls gen2 from an esp enabled HDinsights cluster

VIVEK B 1 Reputation point
2021-10-06T03:29:11.663+00:00

Hallo All,

I have configured an HDI Cluster with ESP enabled and from the Ambari and Azure Console I can see that all the services are running fine. But when trying to execute a sample pi job even to list files using hdfs dfs -ls , I am getting the following error.
"Caused by: org.apache.hadoop.fs.azurebfs.oauth2.AzureADAuthenticator$HttpException: HTTP Error -1CustomTokenProvider getAccessToken threw java.io.IOException : com.microsoft.azure.storage.exceptions.TokenNotFoundException: Token does not exist for user:xxxxx in TokenManager"

Kindly note that I am using ADLS Gen2 as the storage for my cluster. Any help is much appreciated.

Thanks and Regards,
Vivek

Azure HDInsight
Azure HDInsight
An Azure managed cluster service for open-source analytics.
208 questions
{count} votes

1 answer

Sort by: Most helpful
  1. VIVEK B 1 Reputation point
    2021-10-12T15:21:39.267+00:00

    Hello @PRADEEPCHEEKATLA-MSFT ,

    Thanks for the response.. I will update the details you have asked asap.

    Warm Regards,
    Vivek

    0 comments No comments