Connecting Logic App Workflow to Azure Data Factory

Question

Connecting Logic App Workflow to Azure Data Factory

Sharon 60

Hi Team,

This is also a quick follow up question again for https://learn.microsoft.com/en-us/answers/questions/1422049/connecting-logic-app-workflow-to-cosmos-db-as-to-l. Thanks to the community help we succeeded today by setting up the destination on Cosmos DB.

The question will be if we can switch the destination of loading the security recommendations data to Azure Data Factory ( and then load the data to Cosmos DB, just to have one centralized data pipeline workflows). We tried to set up the data set in ADF but both logic app and log analytics are not the options available on the dataset dropdown of ADF.

If setting it up on Logic App workflow is the right track, we encountered a blocker when setting up the destination step "Create a pipeline run" in ADF. Screenshot 2023-11-14 at 4.39.37 PM

As it requires a pipeline in ADF to load the data, can the team let us know how to get the security recommendation data from log analytics load into ADF using Logic App workflow?

Accepted answer

0 additional answers

Your answer

Answer 1

Amira Bedhiafi 33,071 Volunteer Moderator

Create a new pipeline that includes a Copy Data activity. The source for this activity will be the output of your Logic Apps query, and the sink will be your Cosmos DB.

Then define parameters in your ADF pipeline if you need to pass any specific data from Logic Apps, like the result of the Run query and list results step.

Go back to to your Logic App, after the Run query and list results step, use the Create a pipeline run action to invoke the ADF pipeline you created. You'll need to provide the name of the ADF pipeline and any parameters it expects.

Please test and tell us :)

Sharon 60 Reputation points

2023-11-16T01:15:02.34+00:00

hey Amira, thank you for the response!

For following on the steps you suggested, can you elaborate a bit more on the " The source of this activity of Logic Apps query"? This is exactly where we were blocked as when creating source data set, we don't see the Logic App as an option for source data set.
Amira Bedhiafi 33,071 Reputation points Volunteer Moderator

2023-11-16T10:23:38.9833333+00:00

You'll need to use Azure storage or a database as an intermediary because there isn't a direct "Logic App" data source in ADF. Essentially, your Logic App will execute a query and store the results, typically in JSON format, to an Azure Blob Storage or an Azure SQL Database. Then, in ADF, you create a dataset that points to this storage or database location to use as the source in your Copy Data activity. The ADF pipeline is then triggered by the Logic App using the "Create a pipeline run" action, where you can pass any required parameters. This setup ensures that the data output by the Logic App is accessible to ADF for further processing and loading into Cosmos DB.
Sharon 60 Reputation points

2023-11-16T18:47:08.1133333+00:00

thank you Amira, this answer clarifies my confusions on setting up the data source for the pipeline.

Share via

Connecting Logic App Workflow to Azure Data Factory

0 additional answers

Your answer