Delete data from an Azure SQL database after copyingit to an Azure Blob

Question

How can I create a pipeline in ADF to delete data from an Azure SQL database after copying it to an Azure Blob, without using the copy or lookup activities to execute the query? I need to create a view and perform some activity. Is there a custom method to achieve this?

Answer 1

If you're using data mapping flows in ADF, there's a n activity available for executing custom SQL scripts:

• Azure Data Factory mapping data flows adds SQL scripts to sink transformation

In a standard pipeline, you can use the Stored Procedure activity to achieve this:

• Transform data by using the SQL Server Stored Procedure activity in Azure Data Factory

You'll need to write the delete logic in a stored procedure and then invoke this stored procedure from Data Factory.