Only getting one element of a JSON array via API using ADF pipeline

Dave Gray 581 Reputation points
2023-03-16T14:29:45.4333333+00:00

Hi,

Just testing out consuming REST APIs inside of ADF pipelines. I'm using a free anonymous API https://api.publicapis.org/entries which should return 1425 elements in the array entries.

User's image

I'm writing the output to an Azure SQL database table and all is fine, except I only get one row. There are no errors or feedback to indicate why just the one row.

I have not set anything specific for paging but I should not really to need to (I think) as the URL above returns everything in one page.

Can anyone please advise?

Kind regards.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,471 questions
{count} votes

1 answer

Sort by: Most helpful
  1. ShaikMaheer-MSFT 37,816 Reputation points Microsoft Employee
    2023-03-20T06:49:02.9166667+00:00

    Hi Dave Gray,

    Thank you for posting query in Microsoft Q&A Platform.

    Your mappings tab shows its configured for only one row with index 0. Kindly use collection reference to flat your entries array as shown in below gif.

    collectionReference

    Hope this helps. Please let me know if any further questions.


    Please consider hitting Accept Answer button. Accepted answers help community as well.

    2 people found this answer helpful.