Move data from Azure SQL DB into Lakehouse via copy assistant
This tutorial describes the steps to move data into Lakehouse.
Two approaches are provided using the copy assistant:
- The first approach moves source data into destination tables with delta format.
- The second approach moves source data into destination files.
Prerequisites
To get started, you must complete the following prerequisites:
- A tenant account with an active subscription. Create an account for free.
- A workspace is created.
- A Lakehouse is created in your workspace.
Move files into Lakehouse as tables in delta format via copy assistant
Follow these steps to set up your copy activity.
Step 1: Start with copy assistant
Open an existing data pipeline or create a new data pipeline.
Select Copy data on the canvas to open the Copy Assistant tool to get started. Or select Use copy assistant from the Copy data drop down list under Activities tab on the ribbon.
Step 2: Configure your source
Choose your data source by choosing a data source type. In this tutorial, we'll use Azure SQL Database as an example. Scroll down on the Choose data source screen to find and select Azure SQL Database and then select Next.
Create a connection to your data source by selecting New Connection, and filling in the required connection information on the panel.
After you fill in the required connection information on the panel, select Next.
Once your connection is created successfully, you will see a list of tables you can select.
Select the table(s) that is to be moved. Then, select Next.
Step 3: Configure your destination
Choose Lakehouse as your destination and then go to next.
Select your existing Lakehouse from your current workspace directly and then go to next.
Configure your table settings in Lakehouse.Select Tables under Root folder and specify the table name. Select Next to continue.
Select OK to finish the assistant experience.
Step 4: Save your data pipeline and run it to load data
Select Save. Then, select Run
Select the glasses icon to view the details for each copy activity run:
Step 5: View your tables from Lakehouse
Go to your Lakehouse and refresh your Lake view to see the latest data ingested.
Switch to Table view to view the data in table.
Note
Currently data lands into Lakehouse Tables folders (a managed area) in Delta format only. Those files will be automatically registered as a table and be visible under Table view from Lakehouse portal. Only the first layer folders under Tables will be registered as delta table. Browsing or Previewing from Lakehouse Table isn't supported yet. Data that gets loaded into the same table will be appended. Delete or Update to tables isn't supported yet.
Related content
This sample shows you how to move data from Azure SQL DB into Lakehouse with the Copy Assistant in Data Factory for Microsoft Fabric. You learned how to:
- Move files into Lakehouse as tables in delta format with the Copy Assistant.
Next, advance to learn more about monitoring your pipeline runs.
Feedback
https://aka.ms/ContentUserFeedback.
Coming soon: Throughout 2024 we will be phasing out GitHub Issues as the feedback mechanism for content and replacing it with a new feedback system. For more information see:Submit and view feedback for