Data Factory metrics and alerts

APPLIES TO: Azure Data Factory Azure Synapse Analytics

Azure Data Factory provides the following metrics and alerts to enable monitoring of the service.

Data Factory metrics

With Azure Monitor, you can gain visibility into the performance and health of your Azure workloads. The most important type of Monitor data is the metric, which is also called the performance counter. Metrics are emitted by most Azure resources. Monitor provides several ways to configure and consume these metrics for monitoring and troubleshooting.

Here are some of the metrics emitted by Azure Data Factory version 2.

Metric Metric display name Unit Aggregation type Description
ActivityCancelledRuns Canceled activity runs metrics Count Total The total number of activity runs that were canceled within a minute window.
ActivityFailedRuns Failed activity runs metrics Count Total The total number of activity runs that failed within a minute window.
ActivitySucceededRuns Succeeded activity runs metrics Count Total The total number of activity runs that succeeded within a minute window.
PipelineCancelledRuns Canceled pipeline runs metrics Count Total The total number of pipeline runs that were canceled within a minute window.
PipelineFailedRuns Failed pipeline runs metrics Count Total The total number of pipeline runs that failed within a minute window.
PipelineSucceededRuns Succeeded pipeline runs metrics Count Total The total number of pipeline runs that succeeded within a minute window.
TriggerCancelledRuns Canceled trigger runs metrics Count Total The total number of trigger runs that were canceled within a minute window.
TriggerFailedRuns Failed trigger runs metrics Count Total The total number of trigger runs that failed within a minute window.
TriggerSucceededRuns Succeeded trigger runs metrics Count Total The total number of trigger runs that succeeded within a minute window.
SSISIntegrationRuntimeStartCancelled Canceled SSIS integration runtime start metrics Count Total The total number of SSIS integration runtime starts that were canceled within a minute window.
SSISIntegrationRuntimeStartFailed Failed SSIS integration runtime start metrics Count Total The total number of SSIS integration runtime starts that failed within a minute window.
SSISIntegrationRuntimeStartSucceeded Succeeded SSIS integration runtime start metrics Count Total The total number of SSIS integration runtime starts that succeeded within a minute window.
SSISIntegrationRuntimeStopStuck Stuck SSIS integration runtime stop metrics Count Total The total number of SSIS integration runtime stops that were stuck within a minute window.
SSISIntegrationRuntimeStopSucceeded Succeeded SSIS integration runtime stop metrics Count Total The total number of SSIS integration runtime stops that succeeded within a minute window.
SSISPackageExecutionCancelled Canceled SSIS package execution metrics Count Total The total number of SSIS package executions that were canceled within a minute window.
SSISPackageExecutionFailed Failed SSIS package execution metrics Count Total The total number of SSIS package executions that failed within a minute window.
SSISPackageExecutionSucceeded Succeeded SSIS package execution metrics Count Total The total number of SSIS package executions that succeeded within a minute window.
PipelineElapsedTimeRuns Elapsed time pipeline runs metrics Count Total Number of times, within a minute window, a pipeline runs longer than user-defined expected duration. (See more.)
IntegrationRuntimeAvailableMemory Available memory for integration runtime Byte Total The total number of bytes of available memory for the self-hosted integration runtime within a minute window.
IntegrationRuntimeAvailableNodeNumber Available nodes for integration runtime Count Total The total number of nodes available for the self-hosted integration runtime within a minute window.
IntegrationRuntimeCpuPercentage CPU utilization for integration runtime Percent Total The percetange of CPU utilization for the self-hosted integration runtime within a minute window.
IntegrationRuntimeAverageTaskPickupDelay Queue duration for integration runtime Seconds Total The queue duration for the self-hosted integration runtime within a minute window.
IntegrationRuntimeQueueLength Queue length for integration runtime Count Total The total queue length for the self-hosted integration runtime within a minute window.
Maximum allowed entities count Maxixum number of entities Count Total The maximum number of entities in the Azure Data Factory instance.
Maximum allowed factory size (GB unit) Maximum size of entities Gigabyte Total The maximum size of entities in the Azure Data Factory instance.
Total entities count Total number of entities Count Total The total number of entities in the Azure Data Factory instance.
Total factory size (GB unit) Total size of entities Gigabyte Total The total size of entities in the Azure Data Factory instance.

For service limits and quotas please see quotas and limits. To access the metrics, complete the instructions in Azure Monitor data platform.

Note

Except for PipelineElapsedTimeRuns, only events from completed, triggered activity and pipeline runs are emitted. In-progress and debug runs are not emitted. On the other hand, events from all SSIS package executions are emitted, including those that are completed and in progress, regardless of their invocation methods. For example, you can invoke package executions on Azure-enabled SQL Server Data Tools, via T-SQL on SQL Server Management Studio, SQL Server Agent, or other designated tools, and as triggered or debug runs of Execute SSIS Package activities in Data Factory pipelines.

Data Factory alerts

Sign in to the Azure portal, and select Monitor > Alerts to create alerts.

Screenshot that shows alerts in the portal menu.

Create alerts

  1. Select + New Alert Rule to create a new alert.

    Screenshot that shows creating a new alert rule.

  2. Define the alert condition.

    Note

    Make sure to select All in the Filter by resource type dropdown list.

    Screenshot that shows the selections for opening the pane for choosing a resource.

    Screenshot that shows the selections for opening the pane for configuring signal logic.

    Screenshot that shows configuring the signal logic.

  3. Define the alert details.

    Screenshot that shows alert details.

  4. Define the action group.

    Note

    The action group must be created within the same resource group as the data factory instance in order to be available for use from the data factory.

    Screenshot that shows creating a rule, with New action group highlighted.

    Screenshot that shows creating a new action group.

    Screenshot that shows configuring email, SMS, push, and voice.

    Screenshot that shows defining an action group.

Next steps

Configure diagnostics settings and workspace