Changing Default Synapse Integration Runtime Settings

Vamsi Madhav 46 Reputation points
2023-02-23T14:58:31.3266667+00:00

Problem1: Performance issues on one Environment

So my problems started after moving my development pipelines (north europe) to a new domain Synapse Prod (west europe) where our AD works. all my pipelines that run in about 30mins take consistently longer. I cant see any obvious difference in them as I used ARM templates to build them. I exported both the templates and compared and couldnt find much difference.

Problem2: Not able to change the Integration runtime settings

In this process of comparing I was trying to see if there is a way I could change the default Integration Run time on my synapse pipelines ? currently all my pipelines are using "AutoResolveIntegrationRuntime" in both environments.

User's image

Problem3: not able to stop the Runtime from Shell

I tried Stopping the runtime from a Cloud Shell hoping to be able to change the compute size - but ended up with a not so helpful situation that i cant seem to find a way forward with.

PS /home/azureuser> Stop-AzSynapseIntegrationRuntime -WorkspaceName wpabbasynapsedev -Name 'AutoResolveIntegrationRuntime' -Force

Stop-AzSynapseIntegrationRuntime: One or more errors occurred. (Operation returned an invalid status code 'MethodNotAllowed')

Problem4: changing the default Runtime

I also tried changing the pipelines to use a Manually created integrationRuntime - but not really sure where i could enforce this across the pipelines - we use a lot of pipelines with copy, data flows, procedure calls and rest api calls - all of which dont give an option to select a integration runtime. All the documentation i find shows how you could change the default value in ADF where there seems to be an option - but i dont see a similar link for Synapse.

Any help resolving one of the problem would hopefully provide a solution to improve things, and would be appreciated. thanks in advance.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
{count} votes

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.