Azure Data Factory documentation

Azure Data Factory is Azure's cloud ETL service for scale-out serverless data integration and data transformation. It offers a code-free UI for intuitive authoring and single-pane-of-glass monitoring and management. You can also lift and shift existing SSIS packages to Azure and run them with full compatibility in ADF. SSIS Integration Runtime offers a fully managed service, so you don't have to worry about infrastructure management.

What's New in Azure Data Factory

Overview

• What's New in Azure Data Factory
• Change data capture
• Managed Airflow

About Azure Data Factory

Overview

• Introduction to Azure Data Factory

Reference

• Whitepapers
• Pricing
• Understanding pricing through examples
• Manage data factory costs with FinOps
• Manage your environment with DataOps
• Azure Data Factory Blog
• Request a feature

Get started

Concept

• Pipelines and activities in Azure Data Factory
• Pipeline execution and triggers

Quickstart

• Create an Azure Data Factory with UI
• Create an Azure Data Factory with an ARM template
• Use the Copy Data tool

How-To Guide

• Expressions and functions in Azure Data Factory

Tutorial

• Learn data integration at scale with Azure Data Factory

Data movement

Overview

• Data lake and data warehouse migration

Concept

• Copy activity overview
• Copy performance tuning
• Lookup activity overview
• SAP Knowledge Center

Tutorial

• Copy data in cloud
• Copy data in bulk
• Copy data incrementally
• Copy data from a SharePoint Online List

Data transformation

Tutorial

• Create data flow
• Copy and transform data from a REST endpoint
• Data flow expression language
• Debug data flow
• Execute data flow activity inside pipeline
• Monitor data flow
• Data flow performance

Concept

• What are mapping data flows?
• Data transformation expressions in mapping data flow
• Change Data Capture (CDC)

Managed Airflow

Concept

• Managed Airflow

How-To Guide

• How does Managed Airflow work?

Tutorial

• Run an existing pipeline with Managed Airflow

SAP knowledge center

Concept

• Overview
• SAP connectors
• SAP templates
• SAP change data capture (CDC) capabilities

Change data capture (CDC)

Overview

• Change data capture

Concept

• Change data capture resources

Tutorial

• Capture changed data with a CDC resource

Lift and shift SSIS packages

Overview

• SSIS migration assessment rules

Concept

• Integration runtime in Azure Data Factory

Tutorial

• Running SSIS packages in Azure

How-To Guide

• Provision SSIS Integration Runtime
• Join SSIS IR to a virtual network
• Run SSIS packages with Execute SSIS Package activity
• Create and configure a self-hosted integration Runtime

Author, Monitor and Manage

How-To Guide

• Visually monitor Azure data factories
• Troubleshoot Azure Data Factory connectors
• Source Control
• Continuous integration and delivery
• Monitor with Azure Monitor