ADF pipeline remains in Queued status while copying data from As400 or MySQL or Sql Server into BLOB Storage (csv, JSON).

Alinkil, Mithun 21

I have tried both Self Hosted and AZURE integration runtime but it isn't working.

My Current location is Toronato , Canada .For Self Hosted integration Runtime I have selected region as Canada Central .

Can you please help and look into the issue .

1 : The Queued Pipeline runid : e9316c9d-e1f2-4430-b096-6c9c59300f19 . Activity runid : 7bba9e87-1a3b-4e7a-85f4-9c27bdda1687

2 : Data Factory region is Ontario, Canada

Can anyone please help. It is 7 days and i still haven't received any resolution.

PRADEEPCHEEKATLA-MSFT 89,471 Reputation points Microsoft Employee

2020-11-06T08:15:44.737+00:00

Hello @Alinkil, Mithun ,

Thanks for bringing this to our attention. I’m working with the product team and get back to you when I have more information.
PRADEEPCHEEKATLA-MSFT 89,471 Reputation points Microsoft Employee

2020-11-09T09:24:06.33+00:00

Hello @Alinkil, Mithun ,

Could you please help to upload the event log for this IR between date 11-04 and now? We need more info to investigate the issue.

How to send logs to investigate?

In the integration runtime configuration manager, please click on the diagnostics icon, reproduce the error and then click on ‘Send logs’.

You will be able to see the report id, please share that with us to enable viewing logs.
Alinkil, Mithun 21 Reputation points

2020-11-11T14:40:38.607+00:00

Thank you for getting back to me. I am using AutoResolveIntegrationRuntime , i cant see the logs.

Probably if you can check by looking into the RunId 6c8cf3a4-56d0-4e22-b1d8-9ec763f92161.

Pipeline Id : 6bc24501-4444-485a-8bf0-1d5bc865fef4

Attached the status i see on pipeline run. It is only happening while writing in BLOB storage and integration runtime is AutoResolveIntegrationRuntime .

Even with Self Hosted IR it is not working.

Hello @PRADEEPCHEEKATLA-MSFT @KranthiPakala-MSFT

Can you please help . Me and my team is not sure what is happening and our whole development is on hold because of the issue.
Alinkil, Mithun 21 Reputation points

2020-11-12T17:23:32.463+00:00

Hello @PRADEEPCHEEKATLA-MSFT

Any updates? Can you please help.
PRADEEPCHEEKATLA-MSFT 89,471 Reputation points Microsoft Employee

2020-11-16T06:22:27.497+00:00

Hello @Alinkil, Mithun ,

Apologize for the delay in response.

Thanks for sharing the details, currently I’m working with the product team and get back to you when I have more information.
PRADEEPCHEEKATLA-MSFT 89,471 Reputation points Microsoft Employee

2020-11-16T15:08:38.737+00:00

Hello @Alinkil, Mithun ,

The activity on which you have provided running on self-hosted IR.

Could you please confirm if you are using Azure IR or self-hosted IR, if it is on self-hosted IR, try reproducing the issue and upload the event log for that period? Then we can continue to investigate the issue.
Alinkil, Mithun 21 Reputation points

2020-11-16T15:18:23.043+00:00

Hi @PRADEEPCHEEKATLA-MSFT

Thank you for getting back to me.

RunId : a14d25a3-dd73-4b2b-a9bb-5dd7611745c3

Pipeline Id : 33f569b3-6d14-411e-baff-5049cc785ff8

I The above activity is running on Azure IR (AutoResolveIntegrationRuntime) -- this is our Development environment

I have tried running the Pipeline in our PRODUCTION ENVIRONMENT using Azure IR (AutoResolveIntegrationRuntime) and it is working fine.

Only on Development Environment it is not working. The settings are same for both environment
PRADEEPCHEEKATLA-MSFT 89,471 Reputation points Microsoft Employee

2020-11-20T07:52:56.303+00:00

Hello @Alinkil, Mithun ,

Thanks for sharing the details.

I’m working with the product team and get back to you when I have more information.
PRADEEPCHEEKATLA-MSFT 89,471 Reputation points Microsoft Employee

2020-11-23T08:05:16.603+00:00

Hello @Alinkil, Mithun ,

As per the RunId which you have shared, this activity also on the SHIR.

So if you want to run your activity on Azure IR, please make sure the source and sink are all using Azure IR.

If you have an issue on SHIR, please upload the SHIR event log to us, then we can further investigate.

2 answers

Alinkil, Mithun 21 Reputation points

2020-11-09T16:56:14.623+00:00

Hi @PRADEEPCHEEKATLA-MSFT

Thank you for getting back to me. I am using AutoResolveIntegrationRuntime , i cant see the logs.

Probably if you can check by looking into the RunId 6c8cf3a4-56d0-4e22-b1d8-9ec763f92161.

Pipeline Id : 6bc24501-4444-485a-8bf0-1d5bc865fef4

Attached the status i see on pipeline run. It is only happening while writing in BLOB storage and integration runtime is AutoResolveIntegrationRuntime .

Even with Self Hosted IR it is not working.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.
Alinkil, Mithun 21 Reputation points

2020-11-10T14:22:09.743+00:00

Hello @PRADEEPCHEEKATLA-MSFT @KranthiPakala-MSFT

Can you please help . Me and my team is not sure what is happening and our whole development is on hold because of the issue.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

ADF pipeline remains in Queued status while copying data from As400 or MySQL or Sql Server into BLOB Storage (csv, JSON).

2 answers

Your answer