java.lang.NoSuchMethodError: 'java.lang.String com.azure.core.credential.TokenRequestContext.getTenantId()

Question

java.lang.NoSuchMethodError: 'java.lang.String com.azure.core.credential.TokenRequestContext.getTenantId()

sunil.bansal 1

I've created a SparkBatchJob in Azure Synapse and trying to authenticate the SparkBatchClient with hardcoded SP credentials through ClientSecretCredential but getting the below error:

Exception in thread "main" java.lang.NoSuchMethodError: 'java.lang.String com.azure.core.credential.TokenRequestContext.getTenantId()'
at com.azure.identity.implementation.util.IdentityUtil.resolveTenantId(IdentityUtil.java:26)
at com.azure.identity.implementation.IdentityClient.lambda$authenticateWithConfidentialClientCache$29(IdentityClient.java:771)
at reactor.core.publisher.Mono.lambda$fromFuture$2(Mono.java:650)
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:44)
at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64)
at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:157)
at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1816)
at reactor.core.publisher.MonoCacheTime$CoordinatorSubscriber.signalCached(MonoCacheTime.java:337)

I've also tried with setting the environment variable and used DefaultAzureCredentialBuilder to generate the token as well but it also didn't work.

To generate the SP credentials, I've used 'az ad sp create-for-rbac -n <application-name> --skip-assignment' command.

I'm referring the below document to create this sample program:

https://learn.microsoft.com/en-us/java/api/overview/azure/analytics-synapse-spark-readme?view=azure-java-preview

0 comments

1 answer

Your answer

Answer 1

HimanshuSinha 19,637 Microsoft Employee Moderator

Hello @sunil.bansal ,
Thanks for the ask and using Microsoft Q&A platform .
Reading the exception i do not think that its related to service prinicipal and it is not getting some methods .
Can you please try to fork the below git repo and see if that helps ? I see that recently it was updated .

https://github.com/Azure/azure-sdk-for-java/tree/azure-analytics-synapse-spark_1.0.0-beta.5/sdk/synapse/azure-analytics-synapse-spark

Please do let me know how it goes .
Thanks
Himanshu

-------------------------------------------------------------------------------------------------------------------------

Please don't forget to click on or upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
Want a reminder to come back and check responses? Here is how to subscribe to a notification
If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators

sunil.bansal 1 Reputation point

2021-11-17T06:41:36.08+00:00
Now I'm getting the below error:

anagedIdentityCredential authentication unavailable. Connection to IMDS endpoint cannot be established, Connect timed out.
Azure Powershell authentication failed using powershell-core(powershell) with following error: Az.Account module with version >= 2.2.0 is not installed. It needs to be installed to use Azure PowerShell Credential.To mitigate this issue, please refer to the troubleshooting guidelines here at https://aka.ms/azure-identity-java-default-azure-credential-troubleshoot
at com.azure.identity.ChainedTokenCredential.lambda$getToken$3(ChainedTokenCredential.java:79)
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:44)
at reactor.core.publisher.Mono.subscribe(Mono.java:4361)
at reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onComplete(FluxSwitchIfEmpty.java:82)
at reactor.core.publisher.MonoNext$NextSubscriber.onComplete(MonoNext.java:102)
at reactor.core.publisher.FluxFlatMap$FlatMapMain.checkTerminated(FluxFlatMap.java:846)
at reactor.core.publisher.FluxFlatMap$FlatMapMain.drainLoop(FluxFlatMap.java:608)
at reactor.core.publisher.FluxFlatMap$FlatMapMain.innerComplete(FluxFlatMap.java:894)
at reactor.core.publisher.FluxFlatMap$FlatMapInner.onComplete(FluxFlatMap.java:997)

Suppressed: java.lang.Exception: #block terminated with an error at reactor.core.publisher.BlockingSingleSubscriber.blockingGet(BlockingSingleSubscriber.java:99) at reactor.core.publisher.Mono.block(Mono.java:1706) at

sunil.bansal 1

Below is the code snippet which I'm using:

SparkBatchClient batchClient = new SparkClientBuilder().endpoint("https://{WorkspaceName}.dev.azuresynapse.net")
.sparkPoolName("{SparkPoolName}").credential(new DefaultAzureCredentialBuilder().build()).buildSparkBatchClient();

SparkBatchJobOptions options = new SparkBatchJobOptions().setName("Job 1")
    .setFile("abfss://test-analytics@{STORAGE_ACCOUNT}.dfs.core.windows.net/wordcount.py").setClassName("WordCount")
    .setArguments(Arrays.asList(
        String.format("abfss://%s@%s.dfs.core.windows.net/samples/java/wordcount/shakespeare.txt", "test-analytics",
            "{STORAGE_ACCOUNT}"),
        String.format("abfss://%s@%s.dfs.core.windows.net/samples/java/wordcount/sample/", "test-analytics",
            "{STORAGE_ACCOUNT}")))
    .setDriverMemory("28g").setDriverCores(4).setExecutorMemory("28g").setExecutorCores(4).setExecutorCount(2);
batchClient.createSparkBatchJob(options);

Ive set AZURE_CLIENT_ID, AZURE_TENANT_ID, AZURE_CLIENT_SECRET in the environment variable and just to be on safe side, this SP is the contributor for this workspace

Share via

java.lang.NoSuchMethodError: 'java.lang.String com.azure.core.credential.TokenRequestContext.getTenantId()

1 answer

Your answer