How can I parameterize Rest API DataSet or Linked Service while using Data Flow

Deba Nayak 61 Reputation points
2022-11-10T13:58:05.777+00:00

Hi Team,

I have a Rest API data Set which I want to parameterize for Base URL and Relative URL. The idea is to use the same Data Set for multiple end points. I am able to do that using copy activity in pipeline, but from Data Flow as soon as I add parameter for base url and relative URL and pass the value from Debug Setting it fails with below error. If I remove Base URL and Relative URL parameter and hardcode it in the linked service, it works fine. I have tried both Synapse and ADF. Please help what I am doing wrong?

259120-image.png

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,406 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,626 questions
Accepted answer
  1. KranthiPakala-MSFT 46,422 Reputation points Microsoft Employee
    2022-11-11T03:32:02.347+00:00

    Hello @Deba Nayak ,

    Thanks for the question and using MS Q&A platform.

    I suspect something could be wrong with dataset parameters configuration. I just tried a sample in my ADF and it is working for parameterized REST connector. Could you please make sure your configuration is similar to below:

    Dataset Parameters:

    259325-image.png

    **Mapping Dataset Parameters to REST Linked Service parameters: **

    259355-image.png

    Mapping incoming baseURL and relativeURL value dynamically from pipeline parameters to REST Connector dataset parameters which we configured in earlier steps:

    259318-image.png

    For debugging you will have to pass the hardcoded baseURL and relativeURL from Debug Setting as below and then do data preview in your source transformation.

    259319-image.png

    Sample Data Preview looks like below:

    259364-image.png

    Could you please verify your configuration by following above series of steps and let us know if that helps to resolve your issue.

    Thank you

    1 person found this answer helpful.
    0 comments

1 additional answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Deba Nayak 61 Reputation points
    2022-11-11T11:17:25.207+00:00

    Hi @KranthiPakala-MSFT ,

    Thank you for reproducing the scenario in your end.

    I did exactly how you did it and it still failed. Finally, I traced the issue to Linked Service setting "Server Certificate Validation", it needs to be set to false. Now I am able to do data preview

    259494-image.png

    I was wondering if you could make a "Test Connection" in the source, for me that still failing. Or maybe it is supposed to be like that?