Azure synapse Copy data with REST API Source failing with

asked 2022-06-04T06:25:20.503+00:00
Abhinav Gundapaneni 1 Reputation point

I was trying to use the copy data activity in azure synapse where the source system is REST API with multiple pages. I used the pagination settings like the image attached, where the end condition is not known, so we put it as and when no data is returned by the API.

208354-screenshot-2022-06-03-153323.png

Below is the error I'm getting. Please help me resolve this issue.
{
"errorCode": "2200",
"message": "Failure happened on 'Source' side. ErrorCode=UserErrorMoreThanOneObjectsReturned,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=More than one objects returned\r\n{\r\n \"Id\": \"a8f4221f-7250-453f-80f7-207deaeaa0ea\",\r\n \"ChangeVersion\": 105422\r\n}\r\n{\r\n \"Id\": \"cfbaa3bf-0c90-477e-aacf-974ef425fa8d\",\r\n \"ChangeVersion\": 105423\r\n}\r\n{\r\n \"Id\": \"6c60adc7-461b-4f0c-994d-35ac95d12fb2\",\r\n \"ChangeVersion\": 105773\r\n}\r\n{\r\n \"Id\": \"20cbec8b-3d7f-4e42-bd19-c6e86f370d3c\",\r\n \"ChangeVersion\": 105779\r\n},Source=Microsoft.DataTransfer.ClientLibrary,'",
"failureType": "UserError",
"target": "Copy Deletes to stage1",
"details": []
}

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
2,600 questions
No comments
{count} votes

1 answer

Sort by: Most helpful
  1. answered 2022-06-07T16:45:30.543+00:00
    ShaikMaheer-MSFT 28,096 Reputation points Microsoft Employee

    Hi @Abhinav Gundapaneni ,

    Thank you for posting query in Microsoft Q&A Platform.

    Please Note, "end_condition" is user-defined, which indicates the condition that will end the pagination loop in the next HTTP request.

    In your case if there is no end condition, then may be simply ignore it and see if that helps. But having an end condition based on response we get helps.

    Currently now, the end condition which mentions actually see the property called data with values exists or not.

    Always make sure the property which we are pointing in end condition should be present in our response json. For example, As per below end condition, The pagination ends when the value of the specific node in response is empty.
    209147-image.png

    Hope this helps. Please let us know how it goes.

    ----------

    Please consider hitting Accept Answer button. Accepted answers help community as well.