Add Azure SQL Database Change Data Capture (CDC) as source in Real-Time hub

This article describes how to get events from Azure SQL Database Change Data Capture (CDC) into Fabric Real-Time hub.

The Azure SQL Database CDC source connector for Microsoft Fabric event streams allows you to capture a snapshot of the current data in an Azure SQL database. The connector then monitors and records any future row-level changes to this data. Once the changes are captured in the eventstream, you can process this CDC data in real-time and send it to different destinations within Fabric for further processing or analysis.

Note

This source is not supported in the following regions of your workspace capacity: West US3, Switzerland West.

Prerequisites

• Access to a workspace in the Fabric capacity license mode (or) the Trial license mode with Contributor or higher permissions.
• A running Azure SQL server with an Azure SQL database.
• Your Azure SQL database must be publicly accessible and not be behind a firewall or secured in a virtual network.
• Enabled CDC in your Azure SQL database by running the stored procedure sys.sp_cdc_enable_db. For details, see Enable and disable change data capture.

Note

• Mirroring shouldn't be enabled in your database.
• Multiple tables CDC isn't supported.

Get events from an Azure SQL Database CDC

You can get events from an Azure SQL Database CDC into Real-Time hub in one of the ways:

• Using the Data sources page
• Using the Microsoft sources page

Data sources page

1. Sign in to Microsoft Fabric.

2. If you see Power BI at the bottom-left of the page, switch to the Fabric workload by selecting Power BI and then by selecting Fabric.

   

3. Select Real-Time on the left navigation bar.

   

4. On the Real-Time hub page, select + Data sources under Connect to on the left navigation menu.

   

   You can also get to the Data sources page from All data streams or My data streams pages by selecting the + Connect data source button in the top-right corner.

   

4. On the Data sources page, select Microsoft sources category at the top, and then select Connect on the Azure SQL DB (CDC) tile.

   

   Use instructions from the Connect to an Azure SQL Database CDC source section.

Microsoft sources page

1. In Real-Time hub, select Microsoft sources on the left navigation menu. You can use the search box to the type your resource name or use filters (Source, Subscription, Resource group, Region) to search for your resource.

2. In the Source drop-down list, select Azure SQL DB (CDC).

3. For Subscription, select an Azure subscription that has the resource group with your SQL database.

4. For Resource group, select a resource group that has your SQL database.

5. For Region, select a location where your SQL database is located.

6. Now, move the mouse over the name of the SQL database that you want to connect to Real-Time hub in the list of databases, and select the Connect button, or select ... (ellipsis), and then select the Connect button.

   

Connect to an Azure SQL Database CDC source

1. On the Connect page, select New connection.

   

   If you have an existing connection to your Azure SQL Database CDC source, you can select it from the Connection drop-down list, and move on to configuring port and tables.

   

2. In the Connection settings section, enter the following values for your Azure SQL database:

   • Server: Enter the Azure SQL server name from the Azure portal.

   • Database: Enter the Azure SQL database name from the Azure portal.

     

3. Scroll down, and in the Connection credentials section, follow these steps.

   1. For Connection name, enter a name for the connection.

   2. For Authentication kind, select Basic.

      Note

      Currently, Fabric eventstreams supports only Basic authentication.

   3. Enter Username and Password for the database.

   4. Select Connect.

      

4. Now, on the Connect page, do these steps:

   1. Select All tables or enter the table names separated by commas, such as: dbo.table1, dbo.table2.

   2. For Port, the default value is 1433 and can't be modified.

   3. In the Stream details section to the right, select the Fabric workspace where you want to save the eventstream that the Wizard is going to create.

   4. For eventstream name, enter a name for the eventstream. The wizard creates an eventstream with the selected Azure SQL Database CDC as a source.

   5. The Stream name is automatically generated for you by appending -stream to the name of the eventstream. You can see this stream on the Real-time hub All data streams page when the wizard finishes.

   6. Select Next.

      

5. On the Review + connect screen, review the summary, and then select Connect.

   

View data stream details

1. On the Review + connect page, if you select Open eventstream, the wizard opens the eventstream that it created for you with the selected Azure SQL Database CDC as a source. To close the wizard, select Finish at the bottom of the page.

   

2. In Real-Time hub, select All data streams. To see the new data stream, refresh the All data streams page.

   

   For detailed steps, see View details of data streams in Fabric Real-Time hub.

Related content

To learn about consuming data streams, see the following articles:

• Process data streams
• Analyze data streams
• Set alerts on data streams