Share via

Is Azure Data Factory CDC (Preview) Supported for On-Premises SQL Server?

Lex 0 Reputation points
2025-11-18T08:49:22.42+00:00

Hello there,

I am reaching out to request an official clarification regarding the supportability of Azure Data Factory (ADF) Change Data Capture (CDC – Preview) when the source system is an on-premises SQL Server instance.

At the moment, I am encountering conflicting behaviors in the platform as well as inconsistent information across Microsoft Q&A threads, which makes it difficult to determine whether this scenario is officially supported.

My Current Environment and Symptoms

On-premises SQL Server 2022

A fully installed and configured Self-Hosted Integration Runtime (SHIR)

ADF Linked Service to on-prem SQL Server through SHIR (connectivity test successful)

ADF Linked Service to Azure SQL (using Managed Identity, also successful)

However, when I attempt to create a Change Data Capture (CDC) resource in ADF:

The Source Linked Service dropdown does not show any Linked Services that use SHIR

Only cloud-based connections (such as Azure SQL) appear, so I cannot select my on-prem SQL Server as a source for CDC

Conflicting Information Found in Microsoft Documentation / Q&A

Some Microsoft engineers (2024–2025 responses) indicate that

ADF CDC (Preview) does support on-premises SQL Server through SHIR,

provided that:

The Data Factory is in Live mode, and

  The SHIR-based Linked Service is pre-created
  
  They describe the missing dropdown option as a __UI limitation or bug__, not a functional restriction.
  
  __Other official responses__ state that:
  
     __ADF Mapping Data Flows do not support SHIR__,
     
     implying potential CDC limitations or architectural constraints.
     
     __In Microsoft Fabric Data Factory__, Microsoft explicitly states:
     
        __Fabric CDC does not support on-premises data sources at all__

Since I am using classic Azure Data Factory (not Fabric), the above information is contradictory, and it is unclear which rules apply to my environment.

Questions Requiring Official Confirmation

I kindly request definitive answers from the Azure engineering/support team for the following:

1. Does Azure Data Factory (classic, non-Fabric) officially support using CDC (Preview) with an on-premises SQL Server as the source?

If yes, please provide official documentation or prerequisites

(SQL Server version requirements, IR type, network requirements, whether Private Endpoint is required, etc.)

If no, please confirm that this scenario is unsupported and explain the design constraints.

2. Can ADF CDC (Preview) be used with a Self-Hosted Integration Runtime (SHIR)?

If yes, please advise why SHIR-based Linked Services do not appear in the CDC creation UI,

and how to resolve this issue.

If no, please clarify whether this is a known limitation, a bug, or an intentional design.

For example:

Azure IR + Private Endpoint to on-prem SQL?

Using Copy Activity with watermark/CDC functions instead of the CDC preview feature?

Staging data in cloud storage before CDC/Dataflow processing?

Or is CDC fundamentally not designed for on-prem sources?

Why This Clarification Is Critical

Due to the inconsistency in available information, I am unable to determine whether:

My issue is caused by a configuration/UI problem

or

The scenario (on-prem SQL + ADF CDC) is fundamentally unsupported

Your guidance will determine whether we should continue with CDC or redesign our data ingestion architecture using incremental copy patterns.

Thank you very much for your assistance. I look forward to your clarification.

Best regards,

Dear Azure Support Team,

I am reaching out to request an official clarification regarding the supportability of Azure Data Factory (ADF) Change Data Capture (CDC – Preview) when the source system is an on-premises SQL Server instance.

At the moment, I am encountering conflicting behaviors in the platform as well as inconsistent information across Microsoft Q&A threads, which makes it difficult to determine whether this scenario is officially supported.

My Current Environment and Symptoms

On-premises SQL Server 2022

A fully installed and configured Self-Hosted Integration Runtime (SHIR)

ADF Linked Service to on-prem SQL Server through SHIR (connectivity test successful)

ADF Linked Service to Azure SQL (using Managed Identity, also successful)

However, when I attempt to create a Change Data Capture (CDC) resource in ADF:

The Source Linked Service dropdown does not show any Linked Services that use SHIR

Only cloud-based connections (such as Azure SQL) appear, so I cannot select my on-prem SQL Server as a source for CDC

Conflicting Information Found in Microsoft Documentation / Q&A

Some Microsoft engineers (2024–2025 responses) indicate that

ADF CDC (Preview) does support on-premises SQL Server through SHIR,

provided that:

The Data Factory is in Live mode, and

  The SHIR-based Linked Service is pre-created
  
  They describe the missing dropdown option as a __UI limitation or bug__, not a functional restriction.
  
  __Other official responses__ state that:
  
     __ADF Mapping Data Flows do not support SHIR__,
     
     implying potential CDC limitations or architectural constraints.
     
     __In Microsoft Fabric Data Factory__, Microsoft explicitly states:
     
        __Fabric CDC does not support on-premises data sources at all__

Since I am using classic Azure Data Factory (not Fabric), the above information is contradictory, and it is unclear which rules apply to my environment.

Questions Requiring Official Confirmation

I kindly request definitive answers from the Azure engineering/support team for the following:

1. Does Azure Data Factory (classic, non-Fabric) officially support using CDC (Preview) with an on-premises SQL Server as the source?

If yes, please provide official documentation or prerequisites

(SQL Server version requirements, IR type, network requirements, whether Private Endpoint is required, etc.)

If no, please confirm that this scenario is unsupported and explain the design constraints.

2. Can ADF CDC (Preview) be used with a Self-Hosted Integration Runtime (SHIR)?

If yes, please advise why SHIR-based Linked Services do not appear in the CDC creation UI,

and how to resolve this issue.

If no, please clarify whether this is a known limitation, a bug, or an intentional design.

For example:

Azure IR + Private Endpoint to on-prem SQL?

Using Copy Activity with watermark/CDC functions instead of the CDC preview feature?

Staging data in cloud storage before CDC/Dataflow processing?

Or is CDC fundamentally not designed for on-prem sources?

Why This Clarification Is Critical

Due to the inconsistency in available information, I am unable to determine whether:

My issue is caused by a configuration/UI problem

or

The scenario (on-prem SQL + ADF CDC) is fundamentally unsupported

Your guidance will determine whether we should continue with CDC or redesign our data ingestion architecture using incremental copy patterns.

Thank you very much for your assistance. I look forward to your clarification.

Best regards,
Lex

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

0 comments

2 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Anonymous
    2025-11-27T18:48:39.0666667+00:00

    Hi @Lex ,
    Welcome to the Microsoft Q&A and thank you for posting your questions here.
    Q1: Does ADF (classic, non-Fabric) CDC (Preview) support on-premises SQL Server as a source?

    CDC in ADF (Preview) supports SQL Server only when the source is accessible via Azure Integration Runtime (Azure IR). If your SQL Server can be reached through Azure IR (e.g., via VPN, ExpressRoute, Managed VNET, or public endpoint), it can be used as a CDC source. However, if the SQL Server is only reachable via Self-Hosted Integration Runtime (SHIR), this scenario is not supported in the current preview.

    Q2: Can ADF CDC (Preview) be used with Self-Hosted IR (SHIR)?

    No. Official documentation lists Self-Hosted IR as unsupported for CDC resources. CDC runs on Mapping Data Flow compute, which requires Azure IR. SHIR-based Linked Services do not appear in the CDC UI by design, not due to a bug.

    Q3: If CDC cannot be used with on-prem SQL Server, what is the recommended architecture?

    • Option 1: Use incremental copy patterns (watermark or SQL CDC tables) via SHIR with Copy Activity.
    • Option 2: Replicate on-prem SQL data to Azure SQL Database or Managed Instance, then configure CDC from Azure to downstream sinks.
    • Option 3: Consider Microsoft Fabric Data Factory for CDC in Copy jobs, which supports on-prem sources via the on-premises data gateway (different platform).

    ADF CDC (Preview) requires Azure IR and does not support SHIR. This is a product limitation, not a configuration issue.

    Official Docs:

    Was this answer helpful?

    0 comments

  2. AI answer

    2025-11-18T08:49:48.9266667+00:00

    Azure Data Factory (ADF) Change Data Capture (CDC) in its preview phase does support on-premises SQL Server as a source when using a Self-Hosted Integration Runtime (SHIR). However, there are some important considerations and limitations to be aware of:

    1. Source Linked Service Visibility: The issue you are experiencing, where SHIR-based Linked Services do not appear in the CDC creation UI, is noted as a potential UI limitation or bug. While some documentation and responses from Microsoft engineers indicate that CDC (Preview) should support on-premises SQL Server through SHIR, the missing dropdown may hinder your ability to select the source.
    2. Official Documentation: Unfortunately, the context does not provide specific official documentation or prerequisites regarding the exact requirements for using CDC with on-prem SQL Server. It is advisable to check the latest updates from Microsoft or the official Azure Data Factory documentation for any changes or clarifications.
    3. Recommended Architecture: If CDC cannot be used effectively with your current setup, consider alternative architectures such as using Azure Integration Runtime with a Private Endpoint to your on-prem SQL Server, or utilizing Copy Activity with watermark functions instead of relying solely on the CDC preview feature.

    In summary, while there is an indication of support for on-prem SQL Server with ADF CDC (Preview), the UI limitations you are facing may require further investigation or confirmation from Azure support for a definitive answer.

    References:

    AI-generated content may be incorrect. Read our transparency notes for more information.

    Was this answer helpful?

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.