Extracting data from REST API (JSON) in ADF to Azure Data Lake

RJ 1 Reputation point


I have ADF (Azure Data Factory) calling two REST API's in JSON.

  1. Customer IDs
  2. Customer Data. - Customer ID.

Task is to extract the Customer data (JSON2) by passing Customer ID (JSON1) as key, and store it in Parque file format in a Data Lake.

please suggest me possible solutions.

Thank you in advance.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,185 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
1,696 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,441 questions
{count} votes

1 answer

Sort by: Most helpful
  1. MartinJaffer-MSFT 25,931 Reputation points

    Hello @RJ and welcome to Microsoft Q&A.

    It sounds like you are saying you need to make 2 calls, one to fetch some metadata for use in making the second call.

    In this case, you can use a Lookup activity for the first call, and use a portion of the output in the second. The second would be a Copy activity with REST as source and Data Lake Parquet as sink.

    Please tell me if I misunderstood.

    1 person found this answer helpful.
    0 comments No comments