Share via

SSIS CDC Control task Question

sakuraime 2,321 Reputation points
2021-07-17T11:03:28.057+00:00

I have two questions .

  1. I am using visual studio 2019 , and while I try to preview the CDC source , it throws the following error, any idea ? is there any driver missing ? However, actually the package can be running successfully by debug
    115594-image.png
  2. Anyone knows if are there any corresponding TSQL for the following task in CDC control flow ?
    115517-image.png
  3. If the initial load start ( full load of the table ) , the source table can be modified during the full load, coz the full load may need hours and days.? In this case , should I put 'Mark CDC start' at the beginning of the full load ?
  4. Anyone has tried to put the ssis CDC control flow package into Azure Data factory SSIS runtime to execute ? Are there any things need to install to the Azure Data factory SSIS runtime
SQL Server
SQL Server
A family of Microsoft relational database management and analysis systems for e-commerce, line-of-business, and data warehousing solutions.
13,284 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,093 questions
SQL Server Integration Services
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
2,516 questions
0 comments

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. sakuraime 2,321 Reputation points
    2021-07-18T13:24:29.533+00:00

    anyone has the idea ?

    0 comments
  2. ZoeHui-MSFT 35,071 Reputation points
    2021-07-19T02:52:35.123+00:00

    Hi @sakuraime ,

    1.It seems is a known issue, please check the version of the SSIS and refer below KB to resolve the issue.

    kb4500595-fix-cdc-source-preview-fails-with-the-given-key-was-not-present-in-the-dictionary-error-in-sql-server-2017-465162b7-f42f-2fca-886e-20d81eaa03b6

    kb4490435-fix-the-given-key-was-not-present-in-the-dictionary-occurs-if-you-do-a-preview-in-the-cdc-source-in-sql-server-2016-32ef3e95-8e54-fcaf-978e-9b4b4f1a5306

    2.CDC control related you may refer:

    cdc-flow-components
    https://www.mssqltips.com/sqlservertip/5815/sql-server-integration-services-ssis-cdc-tasks-for-incremental-data-loading/

    3.SSIS has the CDC extract and apply functionality built-in, and you can run SSIS CDC data flows either on your on-prem SQL Server, or in an ADF SSIS runtime.
    https://learn.microsoft.com/en-us/sql/integration-services/control-flow/cdc-control-task?view=sql-server-ver15

    Regards，

    Zoe

    If the answer is helpful, please click "Accept Answer" and upvote it.

    Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.
    Hot issues October