Error in copying data to ADLS Gen2

AzureLearner 1 Reputation point
2022-01-25T17:46:07.217+00:00

I am trying to copy data from on-prem dataset to ADLS and Getting this error here:

Operation on target CopyActivity_XXX failed: 'Type=System.TimeoutException,Message=This request operation sent to net.tcp://rdapsgtwy01.XX.XX.microsoft.com:8060/ExternalService.svc/Credential did not receive a reply within the configured timeout (00:01:00). The time allotted to this operation may have been a portion of a longer timeout. This may be because the service is still processing the operation or because the service was unable to send a reply message. Please consider increasing the operation timeout (by casting the channel/proxy to IContextChannel and setting the OperationTimeout property) and ensure that the service is able to connect to the client.,Source=Microsoft.DataTransfer.GatewayCommon,'

Below are the pipeline details:

  1. Using an on-prem source using self-hosted IR.
  2. Using ADLS Sink, created a new folder to load the data from point 1.
  3. Using a copy activity with the above mentioned source & sink.
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,351 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. AnnuKumari-MSFT 31,146 Reputation points Microsoft Employee
    2022-01-31T10:57:47.697+00:00

    Hi @AzureLearner ,
    Thankyou for using Microsoft Q&A platform and posting your query.

    The pipeline failures may have been caused by concurrency issue. In order to avoid the issue I would recommended you to
    1. Add Retry policy on those copy activities
    169845-image.png

    2. Modify the triggering times to avoid multiple concurrent jobs.

    If this reoccurs even after adding retry , I would suggest you to create a support ticket with Microsoft Azure. To get more details on how to raise a support ticket, please go through the following article: Create an Azure support request

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators