Linked service with Self-hosted Integration runtime is not supported in data flow.

Question

Linked service with Self-hosted Integration runtime is not supported in data flow.

Chetan Prakash Edke 5

i created dataset for sql server table using self hosted IR and utilizing that dataset in data flow it saying
Linked service with Self-hosted Integration runtime is not supported in data flow.

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2023-08-09T22:37:43.8966667+00:00

@Chetan Prakash Edke Just checking in to see if any of the below information was helpful. If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. If you have any further query, do let us know.

Thank you
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2023-08-14T22:52:38.34+00:00

@Chetan Prakash Edke We still have not heard back from you. Just wanted to check if the below information was helpful? If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Thank you

2 answers

Your answer

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2023-08-09T22:37:43.8966667+00:00

@Chetan Prakash Edke Just checking in to see if any of the below information was helpful. If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. If you have any further query, do let us know.

Thank you
KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2023-08-14T22:52:38.34+00:00

@Chetan Prakash Edke We still have not heard back from you. Just wanted to check if the below information was helpful? If it answers your query, please do click Accept Answer and Yes for "was this answer helpful", as it might be beneficial to other community members reading this thread. And, if you have any further query do let us know.

Thank you

Answer 1

@Chetan Prakash Edke Welcome to Microsoft Q&A forum and thanks for reaching out here.

In addition to @Nandan Hegde input, here are couple more inputs regarding your query. Currently Self-hosted IR does not support the execution of data flows (SHIR is not supported in data flows). Hence you are receiving the error message. To overcome this problem, you can follow Nandan suggestion, or if you data source is Azure SQL you will have to create a new dataset which uses Azure IR or in case if your data source is not Azure SQL server then you will have to follow the below workaround. Workaround: Nevertheless, as a workaround you can leverage the managed VNET option available in Azure IR to enable data flows to access data stores located inside VNETs or on-premises. For more information please refer to this article: New Data Flow Connector: SQL Server as Source and Sink

Feature Request IDEA: Here are existing ideas to support SHIR in Data flows, feel free to upvote and comment on it.

Hope this info helps.

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

Answer 2

Nandan Hegde 36,146 MVP Volunteer Moderator

Hey,
Sources with Self IR are not supported in dataflows as of now.

Hence you are getting that issue.

You can handle it by creating a staging layer :

Copy the data from n Prem SQL server to Azure blob storage via copy activity and then use that file in Blob within dataflow

Billy G 0 Reputation points

2024-02-08T23:24:37.2466667+00:00

I have a pipeline that is deploying APplicationInsights data to my on-prem DB. Are you saying that after the data has been deployed from the Pipeline that I then need to turn around and load that entire table (millions of records) into Azure Blob Storage in order to be able to to Parse a JSON column into other columns only to re-deploy it back down to my On-Prem DB with the populated columns from the Parsed JSON column? I'm new to Azure Data Foundations but this sounds counter-intuitive. Can you provide some more detail?

Share via

Linked service with Self-hosted Integration runtime is not supported in data flow.

2 answers

Your answer