Data Integration Units (DIU) and self-hosted integration runtime

Question

Hi all, Data Integration Units (DIU) property is not available with self-hosted integration runtime

whereas it could be used with Azure integration runtime. In the absence of this performance mechanism

what else we can use in lieu of this as most of the time heavy load of data to be loaded from on-prem to Azure

cloud. Thanks a lot.

Answer 1

Hi @Samy Abdul ,

Thanks for using Microsoft Q&A forum and posting your query.

If you would like to achieve higher throughput using SHIR, you can either scale up or scale out the Self-hosted IR as described below:

• Scale Up : If the CPU and available memory on the Self-hosted IR node are not fully utilized, but the execution of concurrent jobs is reaching the node's limit, you should scale up by increasing the number of concurrent jobs that can run on a node. See here for instructions. You might also want to scale up when activities time out because the self-hosted IR is overloaded. As shown in the following image, you can increase the maximum capacity for a node:
  
• Scale Out : When processor usage is high and available memory is low on the self-hosted IR, add a new node to help scale out the load across machines. If activities fail because they time out or the self-hosted IR node is offline, it helps if you add a node to the gateway. See here for instructions.

For more information please refer to this doc: Self-hosted integration runtime scalability

Hope this info helps.

----------

• Please don't forget to click on and upvote button whenever the information provided helps you. Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators