How to run Python Scripts on ADF with input from Storage account.

Question

Is it possible to run python script in ADF where input is text files from storage account and output to Azure SQL Database?

Answer 1

Hi @RaiArveen ,

If I understand your ask correctly, you want run a python code which takes file from storage account loads that data to Azure SQL Database. If yes, below is the answer. If no, please help me with understating of your ask better with detailed example may be.

Step1: Create a python code locally which copies input file from storage account and loads it to Azure SQL database.
Step2: Test the python code locally. Save python code as .py file
Step3: Upload .py file to Azure Storage account.
Step4: Use Custom activity, which in turn uses Azure batch services to take the python code from .py file on storage and run it.

Click here to know step by step approach of doing same.

Hope this will help. Please let us know if any further queries.

-------------

Please consider hitting Accept Answer. Accepted answers helps community as well.