You can use Managed identity authentication which is the most secure form of authentication (assuming they are in same tenant)
There is no SP auth supported today in ADF for ADB
This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
So I have given the service principal as a contributor role on databricks resource on azure portal (access contol IAM). Also, I have the details client id, tenant id in my keyvault. Also, I have added the service principal in databricks workspace as well (setting --> Identity and access --> service principal). I want to create a linked service on ADF for databricks using this service principal but I cant find a way to do that. Currently, I am using personal access token to create the linked service but if I plan to leave the organization, the run should continue under that service principal.
You can use Managed identity authentication which is the most secure form of authentication (assuming they are in same tenant)
There is no SP auth supported today in ADF for ADB