Share via

Extract SAP data via API in Azure Data Factory using Data Flow

SanjayR 1 Reputation point
2021-12-09T04:23:23.393+00:00

Hello,

I am trying to extract SAP data via API in Azure Data Factory using Data Flow

API is returning data in JSON format with a mix of simple and complex object type like deep nested structures.

How do I dynamically flattened multiple nested/complex JSON output and map it to Azure SQL DB table?

By dynamic I meant, the complex/nested structure returned by JSON sometime may be empty in which case data flow mapping will fail during execution as attributes under that nested structure was missing like no order details for a specific day.

Thanks,
Sanjay

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. SanjayR 1 Reputation point
    2021-12-17T02:31:59.433+00:00

    Hello @MartinJaffer-MSFT ,

    Thanks for following-up, I think this issue is resolved. However, I have other issue in same scenario.

    API Pagination is not working in Dataflow, check many blogs and even posted questions but no luck so far.

    I put my latest comment in this blog https://learn.microsoft.com/en-us/answers/questions/236150/how-to-perform-pagination-in-azure-data-factory-us.html

    Thanks,
    Sanjay

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.