Az.DataFactory

Azure Data Factory V2 is the data integration platform that goes beyond Azure Data Factory V1's orchestration and batch-processing of time-series log data, with a general purpose app model supporting modern data warehousing patterns and scenarios, lift-and-shift SSIS, and data-driven SaaS applications. Compose and manage reliable and secure data integration workflows at scale. Use native ADF data connectors and Integration Runtimes to move and transform cloud and on-premises data that can be unstructured, semi-structured, and structured with Hadoop, Azure Data Lake, Spark, SQL Server, Cosmos DB and many other data platforms.

Note

APIs that do not have V2 in their signature apply to Azure Data Factory version 1. Version 1 is maintenance mode. Current version is version 2

Data Factories

Add-AzDataFactoryV2DataFlowDebugSessionPackage

Add data flow resource and its dependencies into specific data flow debug session.

Add-AzDataFactoryV2TriggerSubscription

Subscribe the event trigger to external service events.

Get-AzDataFactory

Gets information about Data Factories.

Get-AzDataFactoryActivityWindow

Gets information about activity windows associated with a data factory.

Get-AzDataFactoryDataset

Gets information about datasets in Azure Data Factory.

Get-AzDataFactoryGateway

Gets information about logical gateways in Azure Data Factory.

Get-AzDataFactoryGatewayAuthKey

Gets gateway auth key for an Azure Data Factory.

Get-AzDataFactoryHub

Gets information about hubs in Azure Data Factory.

Get-AzDataFactoryLinkedService

Gets information about linked services in Azure Data Factory.

Get-AzDataFactoryPipeline

Gets information about pipelines in Azure Data Factory.

Get-AzDataFactoryRun

Gets runs for a data slice of a dataset in Azure Data Factory.

Get-AzDataFactorySlice

Gets data slices for a dataset in Azure Data Factory.

Get-AzDataFactoryV2

Gets information about Data Factory.

Get-AzDataFactoryV2ActivityRun

Gets information about activity runs for a pipeline run.

Get-AzDataFactoryV2DataFlow

Gets information about data flows in Data Factory.

Get-AzDataFactoryV2DataFlowDebugSession

Get all active data flow debug sessions by Azure Data Factory

Get-AzDataFactoryV2Dataset

Gets information about datasets in Data Factory.

Get-AzDataFactoryV2IntegrationRuntime

Gets information about integration runtime resources.

Get-AzDataFactoryV2IntegrationRuntimeKey

Gets keys for a self-hosted integration runtime.

Get-AzDataFactoryV2IntegrationRuntimeMetric

Gets metric data for an integration runtime.

Get-AzDataFactoryV2IntegrationRuntimeNode

Gets an integration runtime node information.

Get-AzDataFactoryV2IntegrationRuntimeOutboundNetworkDependenciesEndpoint

Gets the list of outbound network dependencies for a given Azure-SSIS integration runtime.

Get-AzDataFactoryV2LinkedService

Gets information about linked services in Data Factory.

Get-AzDataFactoryV2Pipeline

Gets information about pipelines in Data Factory.

Get-AzDataFactoryV2PipelineRun

Gets information about pipeline runs.

Get-AzDataFactoryV2Trigger

Gets information about triggers in a data factory.

Get-AzDataFactoryV2TriggerRun

Returns information about trigger runs.

Get-AzDataFactoryV2TriggerSubscriptionStatus

Get the status of the subscription for the event trigger to the specified external service events.

Invoke-AzDataFactoryV2DataFlowDebugSessionCommand

Invoke debug action in data flow debug session.

Invoke-AzDataFactoryV2IntegrationRuntimeUpgrade

Upgrades self-hosted integration runtime.

Invoke-AzDataFactoryV2Pipeline

Invokes a pipeline to start a run for it.

Invoke-AzDataFactoryV2TriggerRun

Invokes another instance of a trigger run.

New-AzDataFactory

Creates a data factory.

New-AzDataFactoryDataset

Creates a dataset in Data Factory.

New-AzDataFactoryEncryptValue

Encrypts sensitive data.

New-AzDataFactoryGateway

Creates a gateway for an Azure Data Factory.

New-AzDataFactoryGatewayAuthKey

Creates auth key for an Azure Data Factory Gateway.

New-AzDataFactoryHub

Creates a hub for an Azure Data Factory.

New-AzDataFactoryLinkedService

Links a data store or a cloud service to an Azure Data Factory.

New-AzDataFactoryPipeline

Creates a pipeline in Data Factory.

New-AzDataFactoryV2IntegrationRuntimeKey

Regenerate self-hosted integration runtime key.

New-AzDataFactoryV2LinkedServiceEncryptedCredential

Encrypt credential in linked service with specified integration runtime.

Remove-AzDataFactory

Removes a data factory.

Remove-AzDataFactoryDataset

Removes a dataset from Azure Data Factory.

Remove-AzDataFactoryGateway

Removes a gateway from Azure Data Factory.

Remove-AzDataFactoryHub

Removes a hub from Azure Data Factory.

Remove-AzDataFactoryLinkedService

Removes a linked service from Azure Data Factory.

Remove-AzDataFactoryPipeline

Removes a pipeline from Azure Data Factory.

Remove-AzDataFactoryV2

Removes a data factory.

Remove-AzDataFactoryV2DataFlow

Removes a data flow from Data Factory.

Remove-AzDataFactoryV2Dataset

Removes a dataset from Data Factory.

Remove-AzDataFactoryV2IntegrationRuntime

Removes an integration runtime.

Remove-AzDataFactoryV2IntegrationRuntimeNode

Remove a node with the given name on an integration runtime.

Remove-AzDataFactoryV2LinkedService

Removes a linked service from Data Factory.

Remove-AzDataFactoryV2Pipeline

Removes a pipeline from Data Factory.

Remove-AzDataFactoryV2Trigger

Removes a trigger from a data factory.

Remove-AzDataFactoryV2TriggerSubscription

Unsubscribe the event trigger to external service events.

Resume-AzDataFactoryPipeline

Resumes a suspended pipeline in Data Factory.

Save-AzDataFactoryLog

Downloads log files from Azure HDInsight processing.

Set-AzDataFactoryGateway

Sets the description for a gateway in Azure Data Factory.

Set-AzDataFactoryPipelineActivePeriod

Configures the active period for data slices.

Set-AzDataFactorySliceStatus

Sets the status of slices for a dataset in Azure Data Factory.

Set-AzDataFactoryV2

Creates a data factory.

Set-AzDataFactoryV2DataFlow

Creates a data flow in Data Factory.

Set-AzDataFactoryV2Dataset

Creates a dataset in Data Factory.

Set-AzDataFactoryV2IntegrationRuntime

Updates an integration runtime.

Set-AzDataFactoryV2LinkedService

Links a data store or a cloud service to Data Factory.

Set-AzDataFactoryV2Pipeline

Creates a pipeline in Data Factory.

Set-AzDataFactoryV2Trigger

Creates a trigger in a data factory.

Start-AzDataFactoryV2DataFlowDebugSession

Starts a data flow debug session in Azure Data Factory

Start-AzDataFactoryV2IntegrationRuntime

Starts a managed dedicated integration runtime.

Start-AzDataFactoryV2Trigger

Starts a trigger in a data factory.

Stop-AzDataFactoryV2DataFlowDebugSession

Stops a data flow debug session in Azure Data Factory

Stop-AzDataFactoryV2IntegrationRuntime

Stops a managed dedicated integration runtime.

Stop-AzDataFactoryV2PipelineRun

Stops a pipeline run in a data factory.

Stop-AzDataFactoryV2Trigger

Stops a trigger in a data factory.

Stop-AzDataFactoryV2TriggerRun

Stops a trigger run in a data factory.

Suspend-AzDataFactoryPipeline

Suspends a pipeline in Azure Data Factory.

Sync-AzDataFactoryV2IntegrationRuntimeCredential

Synchronizes credentials among integration runtime nodes.

Update-AzDataFactoryV2

Updates the properties of a data factory.

Update-AzDataFactoryV2IntegrationRuntime

Updates an integration runtime.

Update-AzDataFactoryV2IntegrationRuntimeNode

Updates self-hosted integration runtime node.