Data integration at scale with Azure Data Factory or Azure Synapse Pipeline

Intermediate
Data Engineer
Data Scientist
Azure Data Factory
Azure Synapse Analytics

In this learning path, the students learn how to create and manage data pipelines in the cloud using Azure Data Factory.

Prerequisites

The following pre-requisite should be completed:

  • Successfully log in to the Azure portal.
  • Understand the Azure storage options.
  • Understand the Azure compute options.

Modules in this learning path

In this module, you'll examine Azure Data Factory and the core components that enable you to create large scale data ingestion solutions in the cloud

In this module, you will learn the various methods that can be used to ingest data between various data stores using Azure Data Factory.

In this module, you will learn how to perform common data transformation and cleansing activities within Azure Data Factory without using code.

In this module, you will learn how to implement Slowly Changing Dimension using Azure Data Factory or Azure Synapse Pipelines.

In this module, you will learn how Azure Data Factory can orchestrate large scale data movement by using other Azure Data Platform and Machine Learning technologies.

In this module, you'll see how you can integrate SQL Server Integration Services packages into an Azure Data Factory solution

In this module, you will learn how you can publish your Azure Data Factory work between different environments.

Learn how to ingest data from Azure Data Share into Azure Data Factory pipelines to build automated ingestion pipelines.