Azure Data Factory can't select batch account

DataDolphin 1 Reputation point
2021-10-28T04:44:36.887+00:00

I'm trying to setup Azure Batch to run a Python script using Data Factory. I have already created my batch service and configured a pool and storage, within the same resource group as the Data Factory. However, when I got to run the "custom" activity, my batch resource doesn't appear so I can't select it.

I am using the following guide to run my Python script:
https://learn.microsoft.com/en-us/azure/batch/quick-create-portal#create-a-batch-account

What gives? Is there some way I can force Data Factory to see this batch service?

144337-image.png

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
301 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,514 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. svijay-MSFT 5,201 Reputation points Microsoft Employee
    2021-10-28T18:29:41.007+00:00

    Hello @JordanGreer-0324,

    Thanks for the question and using MS Q&A platform.

    From your question, I understand that you have created your batch service and configured a pool and storage - You are unable to find the provisioned batch service.

    In the custom activity, you would need create a linked service to access it from the adf.

    144607-image.png

    Click on the NEW

    Fill in the values(like batch account , batch url , access keys etc) associated with the batch account that you've created.

    144598-image.png

    Click Save

    Now select, the Azure Batch linked service that you've created.

    144674-image.png

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators