Data Factory/Synapse Copy data activity failing with 500 Internal Server Error. Preview data works

Giri, Seshu 26 Reputation points
2022-09-12T00:23:44.473+00:00

I am downloading a file (CSV) from API using Copy data activity and HTTP connector. Source is fine and I am able to 'Preview the data'. Sink is Blob storage using 'Binary' type.

The pipeline worked onetime and everytime failing with 500 Internal Server Error. 

{  
    "errorCode": "2200",  
    "message": "ErrorCode=HttpRequestFailedWithServerError,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Http request failed with server error, status code 500 InternalServerError, please check your activity settings and remote server issues.\nRequest URL: https://somewebsite/enpoint .,Source=Microsoft.DataTransfer.ClientLibrary,''Type=System.Net.WebException,Message=The remote server returned an error: (500) Internal Server Error.,Source=System,'",  
    "failureType": "UserError",  
    "target": "Download Filess",  
    "details": []  
}
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,368 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,540 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. AnnuKumari-MSFT 30,676 Reputation points Microsoft Employee
    2022-09-12T09:55:11.297+00:00

    Hi @Giri, Seshu ,

    Thankyou for using Microsoft Q&A platform and thanks for posting your question here.

    As I understand your issue you are facing an Internal server error while trying to download the .csv file from API using Copy activity.

    I understand the pipeline worked once , could you please make sure there has been no changes to the pipeline since the last successful run. Please validate the linked service connection is successful.

    Error 500, Internal Server Error can occur due to many reasons. Here are a few error sources:

    • Error occurs due to intermittent/transient issues.
    • Error occurs in the configuration of the webserver.
    • Error occurs due to permissions issues at client-server.
    • Error occurs due to time out.

    In order to validate that the issue is from the source server or not, kindly use other API testing tools like Postman and see the API is working fine or not.

    If the issue is not resolved yet or you still experience the issue consistently, I would recommend raising a support ticket for the support engineer to investigate.

    Hope this will help. Please let us know if any further queries.

    ------------------------------

    • Please don't forget to click on 130616-image.png or upvote 130671-image.png button whenever the information provided helps you.
      Original posters help the community find answers faster by identifying the correct answer. Here is how
    • Want a reminder to come back and check responses? Here is how to subscribe to a notification
    • If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators