ADF:Batch activity customization (slots)

Diego Ros 6 Reputation points
2022-01-19T10:04:08.77+00:00

Hello,
I would like to know if there is a way of specifying some parameters of a batch activity when it is triggered from ADF.
What I really want to do is specifying the number of slots a tasks needs batch-parallel-node-tasks, as I want to parallelize some tasks using the same node. But not all of them need the same resources. By default one task uses one slot, but in my case I need to use two slots for some tasks.
And in the setting for Batch activity in ADF I don't see where I could specify it166353-image.png

As a side thing I already have my pool specified with some slots per node.
Thanks a lot

I have been thinking that it might be possible to specify it using a start task... but I don't really know if that is possible :( or if there is another side way of doing it

Azure Batch
Azure Batch
An Azure service that provides cloud-scale job scheduling and compute management.
302 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,477 questions
0 comments No comments
{count} votes

1 answer

Sort by: Most helpful
  1. svijay-MSFT 5,201 Reputation points Microsoft Employee
    2022-01-20T15:57:29.18+00:00

    Hello @Diego Ros ,

    Thanks for the question and using MS Q&A platform.

    As far as I know - I think it is not feasible using Custom Activity that is there in built. However, Did you happen to make use of web activity in the ADF - invoke the batch service with the required parameters ? Will this meet your requirement ?

    1 person found this answer helpful.