Pass parameters from Web App to Azure Data Factory Pipeline

Question

Respected,

We are designing a Azure Data Factory Pipeline where in a user will upload a file from Web App, the uploaded file will be stored in Azure Blob Storage and the trigger set in

the pipeline will trigger it.

Now, my question is how to pass parameters like the userId from Web App to the pipeline. I need this value to store against the data that is being processed by the pipeline.

Any pointers will be helpful!!

Regards

Answer 1

Hi @jigsm ,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

We can only pass folder path and file name as parameters to pipeline when using event triggers in azure data factory, please refer to this document. Workaround I can think of would be to add the user id as one column in the file when uploading to blob storage. And lookup activity can be used in the pipeline that can read the first row from the file and user id column value can be assigned to a pipeline variable using set variable activity post this. The variable can be used in a way that is needed and user id can be skipped loading into the destination.

If adding flexibility to pass more parameters to event triggers is helpful, I would recommend to post an idea in feedback forum that is closely monitored by data factory product team and will be prioritized in future releases.

Please suggest if this does not align with the requirement or for further queries and we will be glad to assist.