Share via

azure data bricks authentication life cycle with web api .net core ?

Maulik Dave 1 Reputation point
2022-06-26T14:08:15.87+00:00

I have created my web api in .net core and that api is using azure active directory app.
I using azure add AUTH MSAL to generate token.

now I m calling one of the job azure data bricks which is configure in python.

now I m calling that azure data bricks job from my web api with service principle token.

now from python web book I m trying to access blob storage no authentication or token code is inside python script will that script use same token which I passes to call data bricks job or I will need to add code of AUTH in python to get data of blob ??

Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,080 questions
0 comments

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. KranthiPakala-MSFT 46,442 Reputation points Microsoft Employee
    2022-06-27T21:12:43.357+00:00

    Hello @Maulik Dave ,

    Thanks for the question and using MS Q&A platform.

    As per my understanding, you have a web API that calls one of the ADB job using service principal token which executes a Python code. The python code is to access a storage container or folders. You would like to know if you need to specifically configure credentials in your ADF notebook Python code to access the storage account. Please correct if my understanding in not accurate.

    You can read data from public storage accounts without any additional settings. Whereas for private storage accounts, you must configure credentials (a Shared Key or a Shared Access Signature (SAS)) before you can access data in Azure Blob storage, either as session credentials or cluster credentials.

    215507-image.png

    For more info please refer to this articles:

    For leveraging credentials safely in Azure Databricks, it is recommended to you follow the Secret management user guide as shown in Mount an Azure Blob storage container.

    Hope this info helps.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators