Datafactory CDC issue

Question

When using CDC in adf, how to do the full load in the first time when my sink table doesn't have the data loaded. I don't see CDC is automatically taking care of the full load.

Answer 1

@Ravi Kumar

Welcome to the MS Q&A platform.

Yes, you are correct that CDC does not automatically take care of the full load. You will need to perform a full load of the data into your sink table before you can start using CDC to capture changes.

To perform a full load, you can use the Copy Data activity in ADF to copy the data from your source table to your sink table.

Here are the steps to perform a full load using the Copy data activity in ADF:

• Create a pipeline in ADF and add a Copy data activity to it.
• In the Source tab, select the source dataset that contains the data you want to copy.
• In the Sink tab, select the sink dataset that represents the destination table.
• In the Mapping tab, select the columns you want to copy from the source to the sink.
• In the Settings tab, set the Copy behavior to Preserve.
• Run the pipeline to perform the initial load.

After the initial load, you can use the Copy data activity with CDC enabled to perform incremental load.

I hope this helps. Please let me know if you have any further questions.