question

ManishKumarGupta-5983 avatar image
0 Votes"
ManishKumarGupta-5983 asked ShaikMaheer-MSFT commented

Authentication of Azure Dedicated pool using client certificate from Databricks

Hello Team,

I have a requirement of authenticating azure dedicated pool from databricks using SPN client certificate. I want to write data (delta format) from ADLS Gen 1 to Dedicated pool via databricks. Could you please guide on how can we use client certificate for authenticating purpose?

I want to use "com.databricks.spark.sqldw" format to write data in dedicated pool. I am able to write the data using dedicated pool username and password but I want use client certificate for authentication.

Please find below the code I am using for username and password.
df.write \
.mode("overwrite")\
.format("com.databricks.spark.sqldw") \
.option("url", "server_url:port number; database=database_name; user=user; password=password") \
.option("enableServicePrincipalAuth", "true") \
.option("forwardSparkAzureStorageCredentials", "true") \
.option("dbTable", "table_name") \
.option("tempDir", "Blob_TempDir_path") \
.save()

Kindly advice.

azure-databricks
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

1 Answer

ShaikMaheer-MSFT avatar image
1 Vote"
ShaikMaheer-MSFT answered ShaikMaheer-MSFT commented

Hi @ManishKumarGupta-5983 ,

Thank you for posting query in Microsoft Q&A Platform.

If I am not wrong then Spark Synapse connector not supports SPN certificate authentication. I am checking more on this with internal team. I will get back to you with updates. Thank you.

· 2
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Thank you @ShaikMaheer-MSFT for the response. Please let me know if you get any further updates on this.

0 Votes 0 ·
ShaikMaheer-MSFT avatar image ShaikMaheer-MSFT ManishKumarGupta-5983 ·

Hi @ManishKumarGupta-5983 - Got confirmation from internal team as well. ADB only support SPN/secret when accessing the ADLS gen2 storage.

0 Votes 0 ·