Error while running the batch python script in ADF

Question

I am trying to run a simple python script while following instructions mentioned in this documentation https://learn.microsoft.com/en-us/azure/batch/tutorial-run-python-batch-azure-data-factory. However, In ADF, I am getting error "Can not access user storage account, please check storage account settings.". I have checked my batch account settings and my storage account is linked with batch account.

My connection with Batch account and Pool name is correct and I am able to successfully test the batch account connection in ADF

Any suggestions?

Answer 1

Hi @Sourav Agrawal
Based on the information you provided, it seems that the issue is not with the networking settings or container permissions. Since you have tested the script locally and it is working as expected, the issue might be with the way the script is being executed in ADF.

Here are some additional steps you can take to troubleshoot the issue:

• Verify that the storage account key is correct and has not expired. You can regenerate the storage account key from the Azure portal and update the key in your ADF pipeline.
• Check if the linked service for the storage account is configured correctly in ADF. You can do this by going to the "Connections" section of your ADF pipeline and verifying the settings.
• Ensure that the script is being executed correctly in ADF. You can check the script execution by going to the "Monitor & Manage" section of your ADF pipeline and reviewing the logs.

I hope this information helps you. Let me know if you have any further questions or concerns.