How to consume the output of a (SQL) script in a pipeline in a data flow in order to join with data from other external sources?

Question

I'm new to Azure Synapse.

I'm using a (SQL) script in a pipeline to run a query retrieving data from multiple tables located in an Azure SQL Database and then wish to consume that data in a data flow where it will be joined with data pulled from another external database and undergo some transformations and aggregation before being saved to another database. How do I get the data flow to consume the data from the script activity? I can't seem to figure that out, and the documentation only goes on about other pipeline activities such as Lookup or Copy not data flows. I also don't see an option in the script activity as to where to save the actual output.

Answer 1

Hi @Michael MacGregor ,

Thankyou for using Microsoft Q&A platform and thanks for posting your question here.

As I understand your query, you want to know the way to pass the output of script activity into dataflow . Please let me know if that is not the ask here.

You can create parameter inside dataflow and use this expression : @{activity('Script1').output.resultSets} in the parameterTab of Dataflow activity with expression option unchecked. You can then leverage the dataflow parameter in any of the transformations to use it.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you.
  Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators