Events
Mar 31, 11 PM - Apr 2, 11 PM
The ultimate Microsoft Fabric, Power BI, SQL, and AI community-led event. March 31 to April 2, 2025.
Register todayThis browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
Data Factory in Microsoft Fabric brings Power Query and Azure Data Factory together into a modern trusted data integration experience that empowers data and business professionals to extract, load, and transform data for their organization. In addition, powerful data orchestration capabilities enable you to build simple to complex data workflows that orchestrate the steps needed for your data integration needs.
Get data and transformation - Dataflow Gen2 is an evolution of dataflows in Power BI. Dataflow Gen2 is rearchitected to use Fabric compute engines for data processing and transformation. This enables them to ingest and transform data at any scale.
Data orchestration - Using data pipelines already familiar to users of Azure Data Factory (ADF), Microsoft Fabric enables the same orchestration capabilities offered in ADF. As part of the GA release of Fabric, data pipelines support most of the activities available in ADF.
Refer to this list of activities that are a part of data pipelines in Fabric.
Enterprise-ready data movement - Whether it's small data movement or petabyte-scale, Data Factory provides a serverless and intelligent data movement platform that enables you to move data between diverse data sources and data destinations reliably. With support for 170+ connectors, Data Factory in Microsoft Fabric enables you to move data between multiclouds, data sources on-premises, and within virtual networks (VNet). Intelligent throughput optimization enables the data movement platform to automatically detect the size of the compute needed for data movement.
To enable customers to upgrade to Microsoft Fabric from Azure Data Factory (ADF), we support the following features:
Data pipeline activities - We support most of the activities that you already use in ADF to Data Factory in Fabric. In addition, we have added new activities for notifications, for example, the Teams and Outlook activities. Refer to this list of activities that are available in Data Factory in Fabric.
OneLake/Lakehouse connector in Azure Data Factory - For many ADF customers, you can now integrate with Microsoft Fabric, and bring data into the Fabric OneLake.
Azure Data Factory Mapping Dataflow to Fabric - We provide this guide for ADF customers considering building new data transformations in Fabric.
In addition, for customers considering migrating their ADF mapping dataflows to Fabric, you can apply sample code from the Fabric Customer Advisory Team (Fabric CAT) to convert mapping dataflows to Spark code. Find out more at Mapping dataflows to Microsoft Fabric.
Azure Data Factory in Fabric (preview) - We introduce a new capability that allows you to connect to your existing ADF factories from your Fabric workspace. By clicking “Azure Data Factory” inside of your Fabric Data Factory workspace, now you can fully manage your ADF factories directly from the Fabric workspace UI! You can trigger, execute, and monitor your pipelines as you do in ADF but directly inside of Fabric.
As part of the Data Factory in Microsoft Fabric roadmap, we're working towards the preview of the following by Q2 CY2024:
Dataflow Gen2 in Fabric provides many advantages and new capabilities compared to dataflows (Gen1) in Power BI:
We encourage customers to start trying out Dataflow Gen2, either to recreate existing Dataflow Gen1 scenarios or to try out new ones. Early feedback on Dataflow Gen2 helps us evolve and mature product capabilities.
We have a few options for customers to recreate your Gen1 dataflows as Dataflow Gen2:
Also refer to the following article for further considerations: Differences between Dataflow Gen1 and Gen2
Events
Mar 31, 11 PM - Apr 2, 11 PM
The ultimate Microsoft Fabric, Power BI, SQL, and AI community-led event. March 31 to April 2, 2025.
Register todayTraining
Module
Ingest Data with Dataflows in Microsoft Fabric - Training
Data ingestion is crucial in analytics. Microsoft Fabric's Data Factory offers Dataflows for visually creating multi-step data ingestion and transformation using Power Query Online.
Certification
Microsoft Certified: Fabric Data Engineer Associate - Certifications
As a fabric data engineer, you should have subject matter expertise with data loading patterns, data architectures, and orchestration processes.