Pipelines - Get
Gets a pipeline.
GET https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.DataFactory/factories/{factoryName}/pipelines/{pipelineName}?api-version=2018-06-01
URI Parameters
| Name | In | Required | Type | Description |
|---|---|---|---|---|
|
factory
|
path | True |
string minLength: 3maxLength: 63 pattern: ^[A-Za-z0-9]+(?:-[A-Za-z0-9]+)*$ |
The factory name. |
|
pipeline
|
path | True |
string minLength: 1maxLength: 260 pattern: ^[A-Za-z0-9_][^<>*#.%&:\\+?/]*$ |
The pipeline name. |
|
resource
|
path | True |
string minLength: 1maxLength: 90 |
The name of the resource group. The name is case insensitive. |
|
subscription
|
path | True |
string (uuid) |
The ID of the target subscription. The value must be an UUID. |
|
api-version
|
query | True |
string minLength: 1 |
The API version to use for this operation. |
Request Header
| Name | Required | Type | Description |
|---|---|---|---|
| if-none-match |
string |
ETag of the pipeline entity. Should only be specified for get. If the ETag matches the existing entity tag, or if * was provided, then no content will be returned. |
Responses
| Name | Type | Description |
|---|---|---|
| 200 OK |
Azure operation completed successfully. |
|
| Other Status Codes |
The client has made a conditional request and the resource has not been modified. |
|
| Other Status Codes |
An unexpected error response. |
Security
azure_auth
Azure Active Directory OAuth2 Flow.
Type:
oauth2
Flow:
implicit
Authorization URL:
https://login.microsoftonline.com/common/oauth2/authorize
Scopes
| Name | Description |
|---|---|
| user_impersonation | impersonate your user account |
Examples
Pipelines_Get
Sample request
Sample response
Date: Mon, 22 Apr 2019 18:33:51 GMT
X-Content-Type-Options: nosniff
x-ms-correlation-request-id: f3865c61-4888-4b91-a617-9a985d9dd0fd
x-ms-ratelimit-remaining-subscription-reads: 11991
x-ms-request-id: f3865c61-4888-4b91-a617-9a985d9dd0fd
{
"name": "examplePipeline",
"type": "Microsoft.DataFactory/factories/pipelines",
"etag": "1500504f-0000-0200-0000-5cbe090f0000",
"id": "/subscriptions/12345678-1234-1234-1234-123456789012/resourceGroups/exampleResourceGroup/providers/Microsoft.DataFactory/factories/exampleFactoryName/pipelines/examplePipeline",
"properties": {
"description": "Example description",
"activities": [
{
"name": "ExampleForeachActivity",
"type": "ForEach",
"typeProperties": {
"activities": [
{
"name": "ExampleCopyActivity",
"type": "Copy",
"inputs": [
{
"type": "DatasetReference",
"parameters": {
"MyFileName": "examplecontainer.csv",
"MyFolderPath": "examplecontainer"
},
"referenceName": "exampleDataset"
}
],
"outputs": [
{
"type": "DatasetReference",
"parameters": {
"MyFileName": {
"type": "Expression",
"value": "@item()"
},
"MyFolderPath": "examplecontainer"
},
"referenceName": "exampleDataset"
}
],
"typeProperties": {
"dataIntegrationUnits": 32,
"sink": {
"type": "BlobSink"
},
"source": {
"type": "BlobSource"
}
}
}
],
"isSequential": true,
"items": {
"type": "Expression",
"value": "@pipeline().parameters.OutputBlobNameList"
}
}
}
],
"parameters": {
"OutputBlobNameList": {
"type": "Array"
}
},
"policy": {
"elapsedTimeMetric": {
"duration": "0.00:10:00"
}
},
"variables": {
"TestVariableArray": {
"type": "Array"
}
}
}
}
Definitions
| Name | Description |
|---|---|
|
Activity |
Activity dependency information. |
|
Activity |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
Activity |
Execution policy for an activity. |
|
Activity |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
Amazon |
A copy activity Amazon Marketplace Web Service source. |
|
Amazon |
The settings that will be leveraged for AmazonRdsForOracle source partitioning. |
|
Amazon |
A copy activity AmazonRdsForOracle source. |
|
Amazon |
A copy activity Amazon RDS for SQL Server source. |
|
Amazon |
A copy activity source for Amazon Redshift Source. |
|
AmazonS3Compatible |
Amazon S3 Compatible read settings. |
|
AmazonS3Read |
Amazon S3 read settings. |
|
Append |
Append value for a Variable of type Array. |
|
Avro |
A copy activity Avro sink. |
|
Avro |
A copy activity Avro source. |
|
Avro |
Avro write settings. |
|
Azure |
Azure blobFS read settings. |
|
Azure |
A copy activity Azure Data Lake Storage Gen2 sink. |
|
Azure |
A copy activity Azure BlobFS source. |
|
Azure |
Azure blobFS write settings. |
|
Azure |
Azure blob read settings. |
|
Azure |
Azure blob write settings. |
|
Azure |
Azure Databricks Delta Lake export command settings. |
|
Azure |
Azure Databricks Delta Lake import command settings. |
|
Azure |
A copy activity Azure Databricks Delta Lake sink. |
|
Azure |
A copy activity Azure Databricks Delta Lake source. |
|
Azure |
Azure Data Explorer command activity. |
|
Azure |
A copy activity Azure Data Explorer sink. |
|
Azure |
A copy activity Azure Data Explorer (Kusto) source. |
|
Azure |
Azure data lake store read settings. |
|
Azure |
A copy activity Azure Data Lake Store sink. |
|
Azure |
A copy activity Azure Data Lake source. |
|
Azure |
Azure data lake store write settings. |
|
Azure |
Azure File Storage read settings. |
|
Azure |
Azure File Storage write settings. |
|
Azure |
Azure Function activity. |
|
Azure |
The list of HTTP methods supported by a AzureFunctionActivity. |
|
Azure |
Azure Key Vault secret reference. |
|
Azure |
A copy activity Azure MariaDB source. |
|
Azure |
Azure ML Batch Execution activity. |
|
Azure |
Azure ML Execute Pipeline activity. |
|
Azure |
Azure ML Update Resource management activity. |
|
Azure |
Azure ML WebService Input/Output file |
|
Azure |
A copy activity Azure MySql sink. |
|
Azure |
A copy activity Azure MySQL source. |
|
Azure |
A copy activity Azure Database for PostgreSQL sink. |
|
Azure |
Azure Database for PostgreSQL upsert option settings |
|
Azure |
A copy activity Azure Database for PostgreSQL source. |
|
Azure |
The write behavior for the operation. Default is Bulk Insert. |
|
Azure |
A copy activity Azure Queue sink. |
|
Azure |
A copy activity Azure Search Index sink. |
|
Azure |
Specify the write behavior when upserting documents into Azure Search Index. |
|
Azure |
A copy activity Azure SQL sink. |
|
Azure |
A copy activity Azure SQL source. |
|
Azure |
A copy activity Azure Table sink. |
|
Azure |
A copy activity Azure Table source. |
|
Big |
Big data pool reference type. |
|
Big |
Big data pool reference type. |
|
Binary |
Binary read settings. |
|
Binary |
A copy activity Binary sink. |
|
Binary |
A copy activity Binary source. |
|
Blob |
A copy activity Azure Blob sink. |
|
Blob |
A copy activity Azure Blob source. |
|
Cassandra |
A copy activity source for a Cassandra database. |
|
Cassandra |
The consistency level specifies how many Cassandra servers must respond to a read request before returning data to the client application. Cassandra checks the specified number of Cassandra servers for data to satisfy the read request. Must be one of cassandraSourceReadConsistencyLevels. The default value is 'ONE'. It is case-insensitive. |
|
Cloud |
The object that defines the structure of an Azure Data Factory error response. |
|
Common |
A copy activity Common Data Service for Apps sink. |
|
Common |
A copy activity Common Data Service for Apps source. |
|
Concur |
A copy activity Concur Service source. |
|
Configuration |
The type of the spark config. |
|
Continuation |
Continuation settings for execute data flow activity. |
|
Control |
Base class for all control activities like IfCondition, ForEach , Until. |
|
Copy |
Copy activity. |
|
Copy |
Settings for copy activity log. |
|
Cosmos |
A copy activity sink for a CosmosDB (MongoDB API) database. |
|
Cosmos |
A copy activity source for a CosmosDB (MongoDB API) database. |
|
Cosmos |
A copy activity Azure CosmosDB (SQL API) Collection sink. |
|
Cosmos |
A copy activity Azure CosmosDB (SQL API) Collection source. |
|
Couchbase |
A copy activity Couchbase server source. |
|
created |
The type of identity that created the resource. |
|
Credential |
Credential reference type. |
|
Credential |
Credential reference type. |
|
Custom |
Custom activity type. |
|
Custom |
Reference objects for custom activity |
|
Databricks |
Databricks Job activity. |
|
Databricks |
DatabricksNotebook activity. |
|
Databricks |
DatabricksSparkJar activity. |
|
Databricks |
DatabricksSparkPython activity. |
|
Data |
Data flow reference type. |
|
Data |
Data flow reference type. |
|
Data |
Staging info for execute data flow activity. |
|
Data |
Data Lake Analytics U-SQL activity. |
|
Dataset |
Dataset reference type. |
|
Dataset |
Dataset reference type. |
| Db2Source |
A copy activity source for Db2 databases. |
|
Delete |
Delete activity. |
|
Delimited |
Delimited text read settings. |
|
Delimited |
A copy activity DelimitedText sink. |
|
Delimited |
A copy activity DelimitedText source. |
|
Delimited |
Delimited text write settings. |
|
Dependency |
|
|
Distcp |
Distcp settings. |
|
Document |
A copy activity Document Database Collection sink. |
|
Document |
A copy activity Document Database Collection source. |
|
Drill |
A copy activity Drill server source. |
|
DWCopy |
Default value. |
|
DWCopy |
DW Copy Command settings. |
|
Dynamics |
A copy activity Dynamics AX source. |
|
Dynamics |
A copy activity Dynamics CRM sink. |
|
Dynamics |
A copy activity Dynamics CRM source. |
|
Dynamics |
A copy activity Dynamics sink. |
|
Dynamics |
Defines values for DynamicsSinkWriteBehavior. |
|
Dynamics |
A copy activity Dynamics source. |
|
Eloqua |
A copy activity Eloqua server source. |
|
Excel |
A copy activity excel source. |
|
Execute |
Execute data flow activity. |
|
Execute |
Compute properties for data flow activity. |
|
Execute |
Execute pipeline activity. |
|
Execute |
Execution policy for an execute pipeline activity. |
|
Execute |
Execute SSIS package activity. |
|
Execute |
Execute power query activity. |
|
Execution |
Base class for all execution activities. |
| Expression |
Azure Data Factory expression definition. |
|
Expression |
Expression type. |
| ExpressionV2 |
Nested representation of a complex expression. |
| ExpressionV2Type |
Type of expressions supported by the system. Type: string. |
|
Fail |
This activity will fail within its own scope and output a custom error message and error code. The error message and code can provided either as a string literal or as an expression that can be evaluated to a string at runtime. The activity scope can be the whole pipeline or a control activity (e.g. foreach, switch, until), if the fail activity is contained in it. |
|
File |
File server read settings. |
|
File |
File server write settings. |
|
File |
A copy activity file system sink. |
|
File |
A copy activity file system source. |
|
Filter |
Filter and return results from input array based on the conditions. |
|
For |
This activity is used for iterating over a collection and execute given activities. |
|
Ftp |
Ftp read settings. |
|
Get |
Activity to get metadata of dataset |
|
Google |
A copy activity Google AdWords service source. |
|
Google |
A copy activity Google BigQuery service source. |
|
Google |
A copy activity Google BigQuery service source. |
|
Google |
Google Cloud Storage read settings. |
|
Greenplum |
A copy activity Greenplum Database source. |
|
HBase |
A copy activity HBase server source. |
|
Hdfs |
HDFS read settings. |
|
Hdfs |
A copy activity HDFS source. |
|
HDInsight |
The HDInsightActivityDebugInfoOption settings to use. |
|
HDInsight |
HDInsight Hive activity type. |
|
HDInsight |
HDInsight MapReduce activity type. |
|
HDInsight |
HDInsight Pig activity type. |
|
HDInsight |
HDInsight Spark activity. |
|
HDInsight |
HDInsight streaming activity type. |
|
Hive |
A copy activity Hive Server source. |
|
Http |
Http read settings. |
|
Http |
A copy activity source for an HTTP file. |
|
Hubspot |
A copy activity Hubspot Service source. |
|
Iceberg |
A copy activity Iceberg sink. |
|
Iceberg |
Iceberg write settings. |
|
If |
This activity evaluates a boolean expression and executes either the activities under the ifTrueActivities property or the ifFalseActivities property depending on the result of the expression. |
|
Impala |
A copy activity Impala server source. |
|
Informix |
A copy activity Informix sink. |
|
Informix |
A copy activity source for Informix. |
|
Integration |
Integration runtime reference type. |
|
Integration |
Type of integration runtime. |
|
Jira |
A copy activity Jira Service source. |
|
Json |
Json read settings. |
|
Json |
A copy activity Json sink. |
|
Json |
A copy activity Json source. |
|
Json |
Json write settings. |
|
Lake |
Microsoft Fabric Lakehouse Files read settings. |
|
Lake |
A copy activity for Microsoft Fabric Lakehouse Table sink. |
|
Lake |
A copy activity source for Microsoft Fabric Lakehouse Table. |
|
Lake |
Microsoft Fabric Lakehouse Files write settings. |
|
Linked |
Linked service reference type. |
|
Log |
Log location settings. |
|
Log |
Log settings. |
|
Log |
(Deprecated. Please use LogSettings) Log storage settings. |
|
Lookup |
Lookup activity. |
|
Magento |
A copy activity Magento server source. |
|
Maria |
A copy activity MariaDB server source. |
|
Marketo |
A copy activity Marketo server source. |
|
Metadata |
Specify the name and value of custom metadata item. |
|
Microsoft |
A copy activity Microsoft Access sink. |
|
Microsoft |
A copy activity source for Microsoft Access. |
|
Mongo |
A copy activity MongoDB Atlas sink. |
|
Mongo |
A copy activity source for a MongoDB Atlas database. |
|
Mongo |
Cursor methods for Mongodb query |
|
Mongo |
A copy activity source for a MongoDB database. |
|
Mongo |
A copy activity MongoDB sink. |
|
Mongo |
A copy activity source for a MongoDB database. |
|
My |
A copy activity source for MySQL databases. |
|
Netezza |
The settings that will be leveraged for Netezza source partitioning. |
|
Netezza |
A copy activity Netezza source. |
|
Notebook |
Notebook parameter. |
|
Notebook |
Notebook parameter type. |
|
Notebook |
Synapse notebook reference type. |
|
OData |
A copy activity source for OData source. |
|
Odbc |
A copy activity ODBC sink. |
|
Odbc |
A copy activity source for ODBC databases. |
| Office365Source |
A copy activity source for an Office 365 service. |
|
Oracle |
Oracle Cloud Storage read settings. |
|
Oracle |
The settings that will be leveraged for Oracle source partitioning. |
|
Oracle |
A copy activity Oracle Service Cloud source. |
|
Oracle |
A copy activity Oracle sink. |
|
Oracle |
A copy activity Oracle source. |
|
Orc |
A copy activity ORC sink. |
|
Orc |
A copy activity ORC source. |
|
Orc |
Orc write settings. |
|
Parameter |
Definition of a single parameter for an entity. |
|
Parameter |
Parameter type. |
|
Parquet |
Parquet read settings. |
|
Parquet |
A copy activity Parquet sink. |
|
Parquet |
A copy activity Parquet source. |
|
Parquet |
Parquet write settings. |
|
Paypal |
A copy activity Paypal Service source. |
|
Phoenix |
A copy activity Phoenix server source. |
|
Pipeline |
Pipeline ElapsedTime Metric Policy. |
|
Pipeline |
The folder that this Pipeline is in. If not specified, Pipeline will appear at the root level. |
|
Pipeline |
Pipeline Policy. |
|
Pipeline |
Pipeline reference type. |
|
Pipeline |
Pipeline reference type. |
|
Pipeline |
Pipeline resource type. |
|
Polybase |
PolyBase settings. |
|
Polybase |
Indicates whether the RejectValue property is specified as a literal value or a percentage. |
|
Postgre |
A copy activity source for PostgreSQL databases. |
|
Postgre |
A copy activity source for PostgreSQL databases. |
|
Power |
Power query sink. |
|
Power |
Map Power Query mashup query to sink dataset(s). |
|
Presto |
A copy activity Presto server source. |
|
Quick |
A copy activity QuickBooks server source. |
|
Redirect |
Redirect incompatible row settings |
|
Redshift |
The Amazon S3 settings needed for the interim Amazon S3 when copying from Amazon Redshift with unload. With this, data from Amazon Redshift source will be unloaded into S3 first and then copied into the targeted sink from the interim S3. |
|
Relational |
A copy activity source for various relational databases. |
|
Responsys |
A copy activity Responsys source. |
|
Rest |
A copy activity Rest service Sink. |
|
Rest |
A copy activity Rest service source. |
|
Salesforce |
A copy activity Salesforce Marketing Cloud source. |
|
Salesforce |
A copy activity Salesforce Service Cloud sink. |
|
Salesforce |
A copy activity Salesforce Service Cloud source. |
|
Salesforce |
A copy activity Salesforce Service Cloud V2 sink. |
|
Salesforce |
A copy activity Salesforce Service Cloud V2 source. |
|
Salesforce |
A copy activity Salesforce sink. |
|
Salesforce |
The write behavior for the operation. Default is Insert. |
|
Salesforce |
A copy activity Salesforce source. |
| SalesforceV2Sink |
A copy activity Salesforce V2 sink. |
|
SalesforceV2Sink |
The write behavior for the operation. Default is Insert. |
| SalesforceV2Source |
A copy activity Salesforce V2 source. |
|
Sap |
A copy activity source for SapBW server via MDX. |
|
Sap |
A copy activity SAP Cloud for Customer sink. |
|
Sap |
The write behavior for the operation. Default is 'Insert'. |
|
Sap |
A copy activity source for SAP Cloud for Customer source. |
|
Sap |
A copy activity source for SAP ECC source. |
|
Sap |
The settings that will be leveraged for SAP HANA source partitioning. |
|
Sap |
A copy activity source for SAP HANA source. |
|
Sap |
A copy activity source for SAP ODP source. |
|
Sap |
A copy activity source for SAP Business Warehouse Open Hub Destination source. |
|
Sap |
The settings that will be leveraged for SAP table source partitioning. |
|
Sap |
A copy activity source for SAP Table source. |
|
Script |
Script activity type. |
|
Script |
The destination of logs. Type: string. |
|
Script |
Parameters of a script block. |
|
Script |
The direction of the parameter. |
|
Script |
The type of the parameter. |
|
Script |
Script block of scripts. |
|
Script |
Log settings of script activity. |
|
Secure |
Execution policy for an activity that supports secure input and output. |
|
Secure |
Azure Data Factory secure string definition. The string value will be masked with asterisks '*' during Get or List API calls. |
|
Service |
A copy activity ServiceNow server source. |
|
Service |
A copy activity ServiceNowV2 server source. |
|
Set |
Set value for a Variable. |
|
Sftp |
Sftp read settings. |
|
Sftp |
Sftp write settings. |
|
Share |
A copy activity source for sharePoint online list source. |
|
Shopify |
A copy activity Shopify Service source. |
|
Skip |
Skip error file. |
|
Snowflake |
Snowflake export command settings. |
|
Snowflake |
Snowflake import command settings. |
|
Snowflake |
A copy activity snowflake sink. |
|
Snowflake |
A copy activity snowflake source. |
| SnowflakeV2Sink |
A copy activity snowflake sink. |
| SnowflakeV2Source |
A copy activity snowflake source. |
|
Spark |
Spark configuration reference. |
|
Spark |
Spark configuration reference type. |
|
Spark |
Synapse spark job reference type. |
|
Spark |
A copy activity Spark Server source. |
|
Sql |
A copy activity SQL Data Warehouse sink. |
|
Sql |
A copy activity SQL Data Warehouse source. |
|
Sql |
Sql DW upsert option settings |
|
Sql |
A copy activity Azure SQL Managed Instance sink. |
|
Sql |
A copy activity Azure SQL Managed Instance source. |
|
Sql |
The settings that will be leveraged for Sql source partitioning. |
|
Sql |
A copy activity SQL server sink. |
|
Sql |
A copy activity SQL server source. |
|
Sql |
SQL stored procedure activity type. |
|
Sql |
A copy activity SQL sink. |
|
Sql |
A copy activity SQL source. |
|
Sql |
Sql upsert option settings |
|
Square |
A copy activity Square Service source. |
|
SSISAccess |
SSIS access credential. |
|
SSISChild |
SSIS embedded child package. |
|
SSISExecution |
SSIS package execution credential. |
|
SSISExecution |
SSIS execution parameter. |
|
SSISLog |
SSIS package execution log location |
|
Ssis |
The type of SSIS log location. |
|
SSISPackage |
SSIS package location. |
|
Ssis |
The type of SSIS package location. |
|
SSISProperty |
SSIS property override. |
|
Staging |
Staging settings. |
|
Switch |
This activity evaluates an expression and executes activities under the cases property that correspond to the expression evaluation expected in the equals property. |
|
Switch |
Switch cases with have a value and corresponding activities. |
|
Sybase |
A copy activity source for Sybase databases. |
|
Synapse |
Execute Synapse notebook activity. |
|
Synapse |
Synapse notebook reference type. |
|
Synapse |
Execute spark job activity. |
|
Synapse |
Synapse spark job reference type. |
|
system |
Metadata pertaining to creation and last modification of the resource. |
|
Tabular |
Copy activity sources of tabular type. |
|
Tar |
The TarGZip compression read settings. |
|
Tar |
The Tar compression read settings. |
|
Teradata |
Teradata import command settings. |
|
Teradata |
The settings that will be leveraged for teradata source partitioning. |
|
Teradata |
A copy activity Teradata sink. |
|
Teradata |
A copy activity Teradata source. |
| Type |
Linked service reference type. |
|
Until |
This activity executes inner activities until the specified boolean expression results to true or timeout is reached, whichever is earlier. |
|
User |
User property. |
|
Validation |
This activity verifies that an external resource exists. |
|
Variable |
Definition of a single variable for a Pipeline. |
|
Variable |
Variable type. |
|
Vertica |
A copy activity Vertica source. |
|
Wait |
This activity suspends pipeline execution for the specified interval. |
|
Warehouse |
A copy activity Microsoft Fabric Warehouse sink. |
|
Warehouse |
A copy activity Microsoft Fabric Warehouse source. |
|
Web |
Web activity. |
|
Web |
Web activity authentication properties. |
|
Web |
The list of HTTP methods supported by a WebActivity. |
|
Web |
WebHook activity. |
|
Web |
The list of HTTP methods supported by a WebHook activity. |
|
Web |
A copy activity source for web page table. |
|
Xero |
A copy activity Xero Service source. |
|
Xml |
Xml read settings. |
|
Xml |
A copy activity Xml source. |
|
Zip |
The ZipDeflate compression read settings. |
|
Zoho |
A copy activity Zoho server source. |
ActivityDependency
Activity dependency information.
| Name | Type | Description |
|---|---|---|
| activity |
string |
Activity name. |
| dependencyConditions |
Match-Condition for the dependency. |
ActivityOnInactiveMarkAs
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default.
| Value | Description |
|---|---|
| Succeeded |
Succeeded |
| Failed |
Failed |
| Skipped |
Skipped |
ActivityPolicy
Execution policy for an activity.
| Name | Type | Description |
|---|---|---|
| retry |
|
Maximum ordinary retry attempts. Default is 0. Type: integer (or Expression with resultType integer), minimum: 0. |
| retryIntervalInSeconds |
integer (int32) minimum: 30maximum: 86400 |
Interval between each retry attempt (in seconds). The default is 30 sec. |
| secureInput |
boolean |
When set to true, Input from activity is considered as secure and will not be logged to monitoring. |
| secureOutput |
boolean |
When set to true, Output from activity is considered as secure and will not be logged to monitoring. |
| timeout |
|
Specifies the timeout for the activity to run. The default timeout is 7 days. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
ActivityState
Activity state. This is an optional property and if not provided, the state will be Active by default.
| Value | Description |
|---|---|
| Active |
Active |
| Inactive |
Inactive |
AmazonMWSSource
A copy activity Amazon Marketplace Web Service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
AmazonRdsForOraclePartitionSettings
The settings that will be leveraged for AmazonRdsForOracle source partitioning.
| Name | Type | Description |
|---|---|---|
| partitionColumnName |
|
The name of the column in integer type that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
| partitionLowerBound |
|
The minimum value of column specified in partitionColumnName that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
| partitionNames |
|
Names of the physical partitions of AmazonRdsForOracle table. |
| partitionUpperBound |
|
The maximum value of column specified in partitionColumnName that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
AmazonRdsForOracleSource
A copy activity AmazonRdsForOracle source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| numberPrecision |
|
The decimal precision used to represent Oracle NUMBER type without precision and scale. The range is 1 to 256 and default value is 256 if not specified. Type: integer (or Expression with resultType integer). Only used for Version 2.0. |
| numberScale |
|
The decimal scale used to represent Oracle NUMBER type without precision and scale. The range is 0 to 130 and default value is 130 if not specified. Type: integer (or Expression with resultType integer). Only used for Version 2.0. |
| oracleReaderQuery |
|
AmazonRdsForOracle reader query. Type: string (or Expression with resultType string). |
| partitionOption |
|
The partition mechanism that will be used for AmazonRdsForOracle read in parallel. Type: string (or Expression with resultType string). |
| partitionSettings |
The settings that will be leveraged for AmazonRdsForOracle source partitioning. |
|
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
AmazonRdsForSqlServerSource
A copy activity Amazon RDS for SQL Server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| isolationLevel |
|
Specifies the transaction locking behavior for the SQL source. Allowed values: ReadCommitted/ReadUncommitted/RepeatableRead/Serializable/Snapshot. The default value is ReadCommitted. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for Sql read in parallel. Possible values include: "None", "PhysicalPartitionsOfTable", "DynamicRange". |
| partitionSettings |
The settings that will be leveraged for Sql source partitioning. |
|
| produceAdditionalTypes |
|
Which additional types to produce. |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlReaderQuery |
|
SQL reader query. Type: string (or Expression with resultType string). |
| sqlReaderStoredProcedureName |
|
Name of the stored procedure for a SQL Database source. This cannot be used at the same time as SqlReaderQuery. Type: string (or Expression with resultType string). |
| storedProcedureParameters |
|
Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}". |
| type | string: |
Copy source type. |
AmazonRedshiftSource
A copy activity source for Amazon Redshift Source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| redshiftUnloadSettings |
The Amazon S3 settings needed for the interim Amazon S3 when copying from Amazon Redshift with unload. With this, data from Amazon Redshift source will be unloaded into S3 first and then copied into the targeted sink from the interim S3. |
|
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
AmazonS3CompatibleReadSettings
Amazon S3 Compatible read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| prefix |
|
The prefix filter for the S3 Compatible object name. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
Amazon S3 Compatible wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
Amazon S3 Compatible wildcardFolderPath. Type: string (or Expression with resultType string). |
AmazonS3ReadSettings
Amazon S3 read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| prefix |
|
The prefix filter for the S3 object name. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
AmazonS3 wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
AmazonS3 wildcardFolderPath. Type: string (or Expression with resultType string). |
AppendVariableActivity
Append value for a Variable of type Array.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Append |
Type of activity. |
| typeProperties.value |
|
Value to be appended. Type: could be a static value matching type of the variable item or Expression with resultType matching type of the variable item |
| typeProperties.variableName |
string |
Name of the variable whose value needs to be appended to. |
| userProperties |
Activity user properties. |
AvroSink
A copy activity Avro sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
Avro format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings | StoreWriteSettings: |
Avro store settings. |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
AvroSource
A copy activity Avro source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings |
StoreReadSettings:
|
Avro store settings. |
| type | string: |
Copy source type. |
AvroWriteSettings
Avro write settings.
| Name | Type | Description |
|---|---|---|
| fileNamePrefix |
|
Specifies the file name pattern <fileNamePrefix>_<fileIndex>.<fileExtension> when copy from non-file based store without partitionOptions. Type: string (or Expression with resultType string). |
| maxRowsPerFile |
|
Limit the written file's row count to be smaller than or equal to the specified count. Type: integer (or Expression with resultType integer). |
| recordName |
string |
Top level record name in write result, which is required in AVRO spec. |
| recordNamespace |
string |
Record namespace in the write result. |
| type | string: |
The write setting type. |
AzureBlobFSReadSettings
Azure blobFS read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
Azure blobFS wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
Azure blobFS wildcardFolderPath. Type: string (or Expression with resultType string). |
AzureBlobFSSink
A copy activity Azure Data Lake Storage Gen2 sink.
| Name | Type | Description |
|---|---|---|
| copyBehavior |
|
The type of copy behavior for copy sink. Type: string (or Expression with resultType string). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| metadata |
Specify the custom metadata to be added to sink data. Type: array of objects (or Expression with resultType array of objects). |
|
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
AzureBlobFSSource
A copy activity Azure BlobFS source.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| skipHeaderLineCount |
|
Number of header lines to skip from each blob. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| treatEmptyAsNull |
|
Treat empty as null. Type: boolean (or Expression with resultType boolean). |
| type | string: |
Copy source type. |
AzureBlobFSWriteSettings
Azure blobFS write settings.
| Name | Type | Description |
|---|---|---|
| blockSizeInMB |
|
Indicates the block size(MB) when writing data to blob. Type: integer (or Expression with resultType integer). |
| copyBehavior |
|
The type of copy behavior for copy sink. |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| metadata |
Specify the custom metadata to be added to sink data. Type: array of objects (or Expression with resultType array of objects). |
|
| type | string: |
The write setting type. |
AzureBlobStorageReadSettings
Azure blob read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| prefix |
|
The prefix filter for the Azure Blob name. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
Azure blob wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
Azure blob wildcardFolderPath. Type: string (or Expression with resultType string). |
AzureBlobStorageWriteSettings
Azure blob write settings.
| Name | Type | Description |
|---|---|---|
| blockSizeInMB |
|
Indicates the block size(MB) when writing data to blob. Type: integer (or Expression with resultType integer). |
| copyBehavior |
|
The type of copy behavior for copy sink. |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| metadata |
Specify the custom metadata to be added to sink data. Type: array of objects (or Expression with resultType array of objects). |
|
| type | string: |
The write setting type. |
AzureDatabricksDeltaLakeExportCommand
Azure Databricks Delta Lake export command settings.
| Name | Type | Description |
|---|---|---|
| dateFormat |
|
Specify the date format for the csv in Azure Databricks Delta Lake Copy. Type: string (or Expression with resultType string). |
| timestampFormat |
|
Specify the timestamp format for the csv in Azure Databricks Delta Lake Copy. Type: string (or Expression with resultType string). |
| type | string: |
The export setting type. |
AzureDatabricksDeltaLakeImportCommand
Azure Databricks Delta Lake import command settings.
| Name | Type | Description |
|---|---|---|
| dateFormat |
|
Specify the date format for csv in Azure Databricks Delta Lake Copy. Type: string (or Expression with resultType string). |
| timestampFormat |
|
Specify the timestamp format for csv in Azure Databricks Delta Lake Copy. Type: string (or Expression with resultType string). |
| type | string: |
The import setting type. |
AzureDatabricksDeltaLakeSink
A copy activity Azure Databricks Delta Lake sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| importSettings |
Azure Databricks Delta Lake import settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
SQL pre-copy script. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
AzureDatabricksDeltaLakeSource
A copy activity Azure Databricks Delta Lake source.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| exportSettings |
Azure Databricks Delta Lake export settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Azure Databricks Delta Lake Sql query. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
AzureDataExplorerCommandActivity
Azure Data Explorer command activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Azure |
Type of activity. |
| typeProperties.command |
|
A control command, according to the Azure Data Explorer command syntax. Type: string (or Expression with resultType string). |
| typeProperties.commandTimeout |
|
Control command timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9]))..) |
| userProperties |
Activity user properties. |
AzureDataExplorerSink
A copy activity Azure Data Explorer sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| flushImmediately |
|
If set to true, any aggregation will be skipped. Default is false. Type: boolean. |
| ingestionMappingAsJson |
|
An explicit column mapping description provided in a json format. Type: string. |
| ingestionMappingName |
|
A name of a pre-created csv mapping that was defined on the target Kusto table. Type: string. |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
AzureDataExplorerSource
A copy activity Azure Data Explorer (Kusto) source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| noTruncation |
|
The name of the Boolean option that controls whether truncation is applied to result-sets that go beyond a certain row-count limit. |
| query |
|
Database query. Should be a Kusto Query Language (KQL) query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])).. |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
AzureDataLakeStoreReadSettings
Azure data lake store read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| listAfter |
|
Lists files after the value (exclusive) based on file/folder names’ lexicographical order. Applies under the folderPath in data set, and filter files/sub-folders under the folderPath. Type: string (or Expression with resultType string). |
| listBefore |
|
Lists files before the value (inclusive) based on file/folder names’ lexicographical order. Applies under the folderPath in data set, and filter files/sub-folders under the folderPath. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
ADLS wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
ADLS wildcardFolderPath. Type: string (or Expression with resultType string). |
AzureDataLakeStoreSink
A copy activity Azure Data Lake Store sink.
| Name | Type | Description |
|---|---|---|
| copyBehavior |
|
The type of copy behavior for copy sink. Type: string (or Expression with resultType string). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enableAdlsSingleFileParallel |
|
Single File Parallel. |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
AzureDataLakeStoreSource
A copy activity Azure Data Lake source.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
AzureDataLakeStoreWriteSettings
Azure data lake store write settings.
| Name | Type | Description |
|---|---|---|
| copyBehavior |
|
The type of copy behavior for copy sink. |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| expiryDateTime |
|
Specifies the expiry time of the written files. The time is applied to the UTC time zone in the format of "2018-12-01T05:00:00Z". Default value is NULL. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| metadata |
Specify the custom metadata to be added to sink data. Type: array of objects (or Expression with resultType array of objects). |
|
| type | string: |
The write setting type. |
AzureFileStorageReadSettings
Azure File Storage read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| prefix |
|
The prefix filter for the Azure File name starting from root path. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
Azure File Storage wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
Azure File Storage wildcardFolderPath. Type: string (or Expression with resultType string). |
AzureFileStorageWriteSettings
Azure File Storage write settings.
| Name | Type | Description |
|---|---|---|
| copyBehavior |
|
The type of copy behavior for copy sink. |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| metadata |
Specify the custom metadata to be added to sink data. Type: array of objects (or Expression with resultType array of objects). |
|
| type | string: |
The write setting type. |
AzureFunctionActivity
Azure Function activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type | string: |
Type of activity. |
| typeProperties.body |
|
Represents the payload that will be sent to the endpoint. Required for POST/PUT method, not allowed for GET method Type: string (or Expression with resultType string). |
| typeProperties.functionName |
|
Name of the Function that the Azure Function Activity will call. Type: string (or Expression with resultType string) |
| typeProperties.headers |
|
Represents the headers that will be sent to the request. For example, to set the language and type on a request: "headers" : { "Accept-Language": "en-us", "Content-Type": "application/json" }. Type: string (or Expression with resultType string). |
| typeProperties.method |
Rest API method for target endpoint. |
|
| userProperties |
Activity user properties. |
AzureFunctionActivityMethod
The list of HTTP methods supported by a AzureFunctionActivity.
| Value | Description |
|---|---|
| GET |
GET |
| POST |
POST |
| PUT |
PUT |
| DELETE |
DELETE |
| OPTIONS |
OPTIONS |
| HEAD |
HEAD |
| TRACE |
TRACE |
AzureKeyVaultSecretReference
Azure Key Vault secret reference.
| Name | Type | Description |
|---|---|---|
| secretName |
|
The name of the secret in Azure Key Vault. Type: string (or Expression with resultType string). |
| secretVersion |
|
The version of the secret in Azure Key Vault. The default value is the latest version of the secret. Type: string (or Expression with resultType string). |
| store |
The Azure Key Vault linked service reference. |
|
| type |
string:
Azure |
Type of the secret. |
AzureMariaDBSource
A copy activity Azure MariaDB source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
AzureMLBatchExecutionActivity
Azure ML Batch Execution activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Azure |
Type of activity. |
| typeProperties.globalParameters |
|
Key,Value pairs to be passed to the Azure ML Batch Execution Service endpoint. Keys must match the names of web service parameters defined in the published Azure ML web service. Values will be passed in the GlobalParameters property of the Azure ML batch execution request. |
| typeProperties.webServiceInputs |
<string,
Azure |
Key,Value pairs, mapping the names of Azure ML endpoint's Web Service Inputs to AzureMLWebServiceFile objects specifying the input Blob locations.. This information will be passed in the WebServiceInputs property of the Azure ML batch execution request. |
| typeProperties.webServiceOutputs |
<string,
Azure |
Key,Value pairs, mapping the names of Azure ML endpoint's Web Service Outputs to AzureMLWebServiceFile objects specifying the output Blob locations. This information will be passed in the WebServiceOutputs property of the Azure ML batch execution request. |
| userProperties |
Activity user properties. |
AzureMLExecutePipelineActivity
Azure ML Execute Pipeline activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Azure |
Type of activity. |
| typeProperties.continueOnStepFailure |
|
Whether to continue execution of other steps in the PipelineRun if a step fails. This information will be passed in the continueOnStepFailure property of the published pipeline execution request. Type: boolean (or Expression with resultType boolean). |
| typeProperties.dataPathAssignments |
|
Dictionary used for changing data path assignments without retraining. Values will be passed in the dataPathAssignments property of the published pipeline execution request. Type: object (or Expression with resultType object). |
| typeProperties.experimentName |
|
Run history experiment name of the pipeline run. This information will be passed in the ExperimentName property of the published pipeline execution request. Type: string (or Expression with resultType string). |
| typeProperties.mlParentRunId |
|
The parent Azure ML Service pipeline run id. This information will be passed in the ParentRunId property of the published pipeline execution request. Type: string (or Expression with resultType string). |
| typeProperties.mlPipelineEndpointId |
|
ID of the published Azure ML pipeline endpoint. Type: string (or Expression with resultType string). |
| typeProperties.mlPipelineId |
|
ID of the published Azure ML pipeline. Type: string (or Expression with resultType string). |
| typeProperties.mlPipelineParameters |
|
Key,Value pairs to be passed to the published Azure ML pipeline endpoint. Keys must match the names of pipeline parameters defined in the published pipeline. Values will be passed in the ParameterAssignments property of the published pipeline execution request. Type: object with key value pairs (or Expression with resultType object). |
| typeProperties.version |
|
Version of the published Azure ML pipeline endpoint. Type: string (or Expression with resultType string). |
| userProperties |
Activity user properties. |
AzureMLUpdateResourceActivity
Azure ML Update Resource management activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Azure |
Type of activity. |
| typeProperties.trainedModelFilePath |
|
The relative file path in trainedModelLinkedService to represent the .ilearner file that will be uploaded by the update operation. Type: string (or Expression with resultType string). |
| typeProperties.trainedModelLinkedServiceName |
Name of Azure Storage linked service holding the .ilearner file that will be uploaded by the update operation. |
|
| typeProperties.trainedModelName |
|
Name of the Trained Model module in the Web Service experiment to be updated. Type: string (or Expression with resultType string). |
| userProperties |
Activity user properties. |
AzureMLWebServiceFile
Azure ML WebService Input/Output file
| Name | Type | Description |
|---|---|---|
| filePath |
|
The relative file path, including container name, in the Azure Blob Storage specified by the LinkedService. Type: string (or Expression with resultType string). |
| linkedServiceName |
Reference to an Azure Storage LinkedService, where Azure ML WebService Input/Output file located. |
AzureMySqlSink
A copy activity Azure MySql sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
A query to execute before starting the copy. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
AzureMySqlSource
A copy activity Azure MySQL source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
AzurePostgreSqlSink
A copy activity Azure Database for PostgreSQL sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
A query to execute before starting the copy. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| upsertSettings |
Azure Database for PostgreSQL upsert option settings |
|
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeMethod |
The write behavior for the operation. Default is Bulk Insert. |
AzurePostgreSqlSinkUpsertSettings
Azure Database for PostgreSQL upsert option settings
| Name | Type | Description |
|---|---|---|
| keys |
|
Key column names for unique row identification. Type: array of strings (or Expression with resultType array of strings). |
AzurePostgreSqlSource
A copy activity Azure Database for PostgreSQL source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
AzurePostgreSqlWriteMethodEnum
The write behavior for the operation. Default is Bulk Insert.
| Value | Description |
|---|---|
| BulkInsert |
BulkInsert |
| CopyCommand |
CopyCommand |
| Upsert |
Upsert |
AzureQueueSink
A copy activity Azure Queue sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
AzureSearchIndexSink
A copy activity Azure Search Index sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
Specify the write behavior when upserting documents into Azure Search Index. |
AzureSearchIndexWriteBehaviorType
Specify the write behavior when upserting documents into Azure Search Index.
| Value | Description |
|---|---|
| Merge |
Merge |
| Upload |
Upload |
AzureSqlSink
A copy activity Azure SQL sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
SQL pre-copy script. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlWriterStoredProcedureName |
|
SQL writer stored procedure name. Type: string (or Expression with resultType string). |
| sqlWriterTableType |
|
SQL writer table type. Type: string (or Expression with resultType string). |
| sqlWriterUseTableLock |
|
Whether to use table lock during bulk copy. Type: boolean (or Expression with resultType boolean). |
| storedProcedureParameters |
|
SQL stored procedure parameters. |
| storedProcedureTableTypeParameterName |
|
The stored procedure parameter name of the table type. Type: string (or Expression with resultType string). |
| tableOption |
|
The option to handle sink table, such as autoCreate. For now only 'autoCreate' value is supported. Type: string (or Expression with resultType string). |
| type | string: |
Copy sink type. |
| upsertSettings |
SQL upsert settings. |
|
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
Write behavior when copying data into Azure SQL. Type: SqlWriteBehaviorEnum (or Expression with resultType SqlWriteBehaviorEnum) |
AzureSqlSource
A copy activity Azure SQL source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| isolationLevel |
|
Specifies the transaction locking behavior for the SQL source. Allowed values: ReadCommitted/ReadUncommitted/RepeatableRead/Serializable/Snapshot. The default value is ReadCommitted. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for Sql read in parallel. Possible values include: "None", "PhysicalPartitionsOfTable", "DynamicRange". Type: string (or Expression with resultType string). |
| partitionSettings |
The settings that will be leveraged for Sql source partitioning. |
|
| produceAdditionalTypes |
|
Which additional types to produce. |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlReaderQuery |
|
SQL reader query. Type: string (or Expression with resultType string). |
| sqlReaderStoredProcedureName |
|
Name of the stored procedure for a SQL Database source. This cannot be used at the same time as SqlReaderQuery. Type: string (or Expression with resultType string). |
| storedProcedureParameters |
|
Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}". |
| type | string: |
Copy source type. |
AzureTableSink
A copy activity Azure Table sink.
| Name | Type | Description |
|---|---|---|
| azureTableDefaultPartitionKeyValue |
|
Azure Table default partition key value. Type: string (or Expression with resultType string). |
| azureTableInsertType |
|
Azure Table insert type. Type: string (or Expression with resultType string). |
| azureTablePartitionKeyName |
|
Azure Table partition key name. Type: string (or Expression with resultType string). |
| azureTableRowKeyName |
|
Azure Table row key name. Type: string (or Expression with resultType string). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
AzureTableSource
A copy activity Azure Table source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| azureTableSourceIgnoreTableNotFound |
|
Azure Table source ignore table not found. Type: boolean (or Expression with resultType boolean). |
| azureTableSourceQuery |
|
Azure Table source query. Type: string (or Expression with resultType string). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
BigDataPoolParametrizationReference
Big data pool reference type.
| Name | Type | Description |
|---|---|---|
| referenceName |
|
Reference big data pool name. Type: string (or Expression with resultType string). |
| type |
Big data pool reference type. |
BigDataPoolReferenceType
Big data pool reference type.
| Value | Description |
|---|---|
| BigDataPoolReference |
BigDataPoolReference |
BinaryReadSettings
Binary read settings.
| Name | Type | Description |
|---|---|---|
| compressionProperties | CompressionReadSettings: |
Compression settings. |
| type | string: |
The read setting type. |
BinarySink
A copy activity Binary sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings | StoreWriteSettings: |
Binary store settings. |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
BinarySource
A copy activity Binary source.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
Binary format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings |
StoreReadSettings:
|
Binary store settings. |
| type | string: |
Copy source type. |
BlobSink
A copy activity Azure Blob sink.
| Name | Type | Description |
|---|---|---|
| blobWriterAddHeader |
|
Blob writer add header. Type: boolean (or Expression with resultType boolean). |
| blobWriterDateTimeFormat |
|
Blob writer date time format. Type: string (or Expression with resultType string). |
| blobWriterOverwriteFiles |
|
Blob writer overwrite files. Type: boolean (or Expression with resultType boolean). |
| copyBehavior |
|
The type of copy behavior for copy sink. |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| metadata |
Specify the custom metadata to be added to sink data. Type: array of objects (or Expression with resultType array of objects). |
|
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
BlobSource
A copy activity Azure Blob source.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| skipHeaderLineCount |
|
Number of header lines to skip from each blob. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| treatEmptyAsNull |
|
Treat empty as null. Type: boolean (or Expression with resultType boolean). |
| type | string: |
Copy source type. |
CassandraSource
A copy activity source for a Cassandra database.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| consistencyLevel |
The consistency level specifies how many Cassandra servers must respond to a read request before returning data to the client application. Cassandra checks the specified number of Cassandra servers for data to satisfy the read request. Must be one of cassandraSourceReadConsistencyLevels. The default value is 'ONE'. It is case-insensitive. |
|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Should be a SQL-92 query expression or Cassandra Query Language (CQL) command. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
CassandraSourceReadConsistencyLevels
The consistency level specifies how many Cassandra servers must respond to a read request before returning data to the client application. Cassandra checks the specified number of Cassandra servers for data to satisfy the read request. Must be one of cassandraSourceReadConsistencyLevels. The default value is 'ONE'. It is case-insensitive.
| Value | Description |
|---|---|
| ALL |
ALL |
| EACH_QUORUM |
EACH_QUORUM |
| QUORUM |
QUORUM |
| LOCAL_QUORUM |
LOCAL_QUORUM |
| ONE |
ONE |
| TWO |
TWO |
| THREE |
THREE |
| LOCAL_ONE |
LOCAL_ONE |
| SERIAL |
SERIAL |
| LOCAL_SERIAL |
LOCAL_SERIAL |
CloudError
The object that defines the structure of an Azure Data Factory error response.
| Name | Type | Description |
|---|---|---|
| error.code |
string |
Error code. |
| error.details |
Array with additional error details. |
|
| error.message |
string |
Error message. |
| error.target |
string |
Property name/path in request associated with error. |
CommonDataServiceForAppsSink
A copy activity Common Data Service for Apps sink.
| Name | Type | Description |
|---|---|---|
| alternateKeyName |
|
The logical name of the alternate key which will be used when upserting records. Type: string (or Expression with resultType string). |
| bypassBusinessLogicExecution |
|
Controls the bypass of Dataverse custom business logic. Type: string (or Expression with resultType string). Type: string (or Expression with resultType string). |
| bypassPowerAutomateFlows |
|
Controls the bypass of Power Automate flows. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| ignoreNullValues |
|
The flag indicating whether to ignore null values from input dataset (except key fields) during write operation. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
The write behavior for the operation. |
CommonDataServiceForAppsSource
A copy activity Common Data Service for Apps source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
FetchXML is a proprietary query language that is used in Microsoft Common Data Service for Apps (online & on-premises). Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
ConcurSource
A copy activity Concur Service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
ConfigurationType
The type of the spark config.
| Value | Description |
|---|---|
| Default |
Default |
| Customized |
Customized |
| Artifact |
Artifact |
ContinuationSettingsReference
Continuation settings for execute data flow activity.
| Name | Type | Description |
|---|---|---|
| continuationTtlInMinutes |
|
Continuation TTL in minutes. |
| customizedCheckpointKey |
|
Customized checkpoint key. |
| idleCondition |
|
Idle condition. |
ControlActivity
Base class for all control activities like IfCondition, ForEach , Until.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Container |
Type of activity. |
| userProperties |
Activity user properties. |
CopyActivity
Copy activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| inputs |
List of inputs for the activity. |
|
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| outputs |
List of outputs for the activity. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Copy |
Type of activity. |
| typeProperties.dataIntegrationUnits |
|
Maximum number of data integration units that can be used to perform this data movement. Type: integer (or Expression with resultType integer), minimum: 0. |
| typeProperties.enableSkipIncompatibleRow |
|
Whether to skip incompatible row. Default value is false. Type: boolean (or Expression with resultType boolean). |
| typeProperties.enableStaging |
|
Specifies whether to copy data via an interim staging. Default value is false. Type: boolean (or Expression with resultType boolean). |
| typeProperties.logSettings |
Log settings customer needs provide when enabling log. |
|
| typeProperties.logStorageSettings |
(Deprecated. Please use LogSettings) Log storage settings customer need to provide when enabling session log. |
|
| typeProperties.parallelCopies |
|
Maximum number of concurrent sessions opened on the source or sink to avoid overloading the data store. Type: integer (or Expression with resultType integer), minimum: 0. |
| typeProperties.preserve |
Copy |
Preserve rules. |
| typeProperties.preserveRules |
Copy |
Preserve Rules. |
| typeProperties.redirectIncompatibleRowSettings |
Redirect incompatible row settings when EnableSkipIncompatibleRow is true. |
|
| typeProperties.sink |
CopySink:
|
Copy activity sink. |
| typeProperties.skipErrorFile |
Specify the fault tolerance for data consistency. |
|
| typeProperties.source |
CopySource:
|
Copy activity source. |
| typeProperties.stagingSettings |
Specifies interim staging settings when EnableStaging is true. |
|
| typeProperties.translator |
|
Copy activity translator. If not specified, tabular translator is used. |
| typeProperties.validateDataConsistency |
|
Whether to enable Data Consistency validation. Type: boolean (or Expression with resultType boolean). |
| userProperties |
Activity user properties. |
CopyActivityLogSettings
Settings for copy activity log.
| Name | Type | Description |
|---|---|---|
| enableReliableLogging |
|
Specifies whether to enable reliable logging. Type: boolean (or Expression with resultType boolean). |
| logLevel |
|
Gets or sets the log level, support: Info, Warning. Type: string (or Expression with resultType string). |
CosmosDbMongoDbApiSink
A copy activity sink for a CosmosDB (MongoDB API) database.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
Specifies whether the document with same key to be overwritten (upsert) rather than throw exception (insert). The default value is "insert". Type: string (or Expression with resultType string). Type: string (or Expression with resultType string). |
CosmosDbMongoDbApiSource
A copy activity source for a CosmosDB (MongoDB API) database.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| batchSize |
|
Specifies the number of documents to return in each batch of the response from MongoDB instance. In most cases, modifying the batch size will not affect the user or the application. This property's main purpose is to avoid hit the limitation of response size. Type: integer (or Expression with resultType integer). |
| cursorMethods |
Cursor methods for Mongodb query. |
|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| filter |
|
Specifies selection filter using query operators. To return all documents in a collection, omit this parameter or pass an empty document ({}). Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
CosmosDbSqlApiSink
A copy activity Azure CosmosDB (SQL API) Collection sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
Describes how to write data to Azure Cosmos DB. Type: string (or Expression with resultType string). Allowed values: insert and upsert. |
CosmosDbSqlApiSource
A copy activity Azure CosmosDB (SQL API) Collection source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| detectDatetime |
|
Whether detect primitive values as datetime values. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| pageSize |
|
Page size of the result. Type: integer (or Expression with resultType integer). |
| preferredRegions |
|
Preferred regions. Type: array of strings (or Expression with resultType array of strings). |
| query |
|
SQL API query. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
CouchbaseSource
A copy activity Couchbase server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
createdByType
The type of identity that created the resource.
| Value | Description |
|---|---|
| User | |
| Application | |
| ManagedIdentity | |
| Key |
CredentialReference
Credential reference type.
| Name | Type | Description |
|---|---|---|
| referenceName |
string |
Reference credential name. |
| type |
Credential reference type. |
CredentialReferenceType
Credential reference type.
| Value | Description |
|---|---|
| CredentialReference |
CredentialReference |
CustomActivity
Custom activity type.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Custom |
Type of activity. |
| typeProperties.autoUserSpecification |
|
Elevation level and scope for the user, default is nonadmin task. Type: string (or Expression with resultType double). |
| typeProperties.command |
|
Command for custom activity Type: string (or Expression with resultType string). |
| typeProperties.extendedProperties |
|
User defined property bag. There is no restriction on the keys or values that can be used. The user specified custom activity has the full responsibility to consume and interpret the content defined. |
| typeProperties.folderPath |
|
Folder path for resource files Type: string (or Expression with resultType string). |
| typeProperties.referenceObjects |
Reference objects |
|
| typeProperties.resourceLinkedService |
Resource linked service reference. |
|
| typeProperties.retentionTimeInDays |
|
The retention time for the files submitted for custom activity. Type: double (or Expression with resultType double). |
| userProperties |
Activity user properties. |
CustomActivityReferenceObject
Reference objects for custom activity
| Name | Type | Description |
|---|---|---|
| datasets |
Dataset references. |
|
| linkedServices |
Linked service references. |
DatabricksJobActivity
Databricks Job activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Databricks |
Type of activity. |
| typeProperties.jobId |
|
The Id of the Databricks Job to be executed. Type: string (or Expression with resultType string). |
| typeProperties.jobParameters |
|
Job parameters to be used for each run of this job. If the job takes a parameter that is not specified, the default value from the job will be used. |
| userProperties |
Activity user properties. |
DatabricksNotebookActivity
DatabricksNotebook activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Databricks |
Type of activity. |
| typeProperties.baseParameters |
|
Base parameters to be used for each run of this job.If the notebook takes a parameter that is not specified, the default value from the notebook will be used. |
| typeProperties.libraries |
Databricks |
A list of libraries to be installed on the cluster that will execute the job. |
| typeProperties.notebookPath |
|
The absolute path of the notebook to be run in the Databricks Workspace. This path must begin with a slash. Type: string (or Expression with resultType string). |
| userProperties |
Activity user properties. |
DatabricksSparkJarActivity
DatabricksSparkJar activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Databricks |
Type of activity. |
| typeProperties.libraries |
Databricks |
A list of libraries to be installed on the cluster that will execute the job. |
| typeProperties.mainClassName |
|
The full name of the class containing the main method to be executed. This class must be contained in a JAR provided as a library. Type: string (or Expression with resultType string). |
| typeProperties.parameters |
Databricks |
Parameters that will be passed to the main method. |
| userProperties |
Activity user properties. |
DatabricksSparkPythonActivity
DatabricksSparkPython activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Databricks |
Type of activity. |
| typeProperties.libraries |
Databricks |
A list of libraries to be installed on the cluster that will execute the job. |
| typeProperties.parameters |
Databricks |
Command line parameters that will be passed to the Python file. |
| typeProperties.pythonFile |
|
The URI of the Python file to be executed. DBFS paths are supported. Type: string (or Expression with resultType string). |
| userProperties |
Activity user properties. |
DataFlowReference
Data flow reference type.
| Name | Type | Description |
|---|---|---|
| datasetParameters |
|
Reference data flow parameters from dataset. |
| parameters |
|
Data flow parameters |
| referenceName |
string |
Reference data flow name. |
| type |
Data flow reference type. |
DataFlowReferenceType
Data flow reference type.
| Value | Description |
|---|---|
| DataFlowReference |
DataFlowReference |
DataFlowStagingInfo
Staging info for execute data flow activity.
| Name | Type | Description |
|---|---|---|
| folderPath |
|
Folder path for staging blob. Type: string (or Expression with resultType string) |
| linkedService |
Staging linked service reference. |
DataLakeAnalyticsUSQLActivity
Data Lake Analytics U-SQL activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Data |
Type of activity. |
| typeProperties.compilationMode |
|
Compilation mode of U-SQL. Must be one of these values : Semantic, Full and SingleBox. Type: string (or Expression with resultType string). |
| typeProperties.degreeOfParallelism |
|
The maximum number of nodes simultaneously used to run the job. Default value is 1. Type: integer (or Expression with resultType integer), minimum: 1. |
| typeProperties.parameters |
|
Parameters for U-SQL job request. |
| typeProperties.priority |
|
Determines which jobs out of all that are queued should be selected to run first. The lower the number, the higher the priority. Default value is 1000. Type: integer (or Expression with resultType integer), minimum: 1. |
| typeProperties.runtimeVersion |
|
Runtime version of the U-SQL engine to use. Type: string (or Expression with resultType string). |
| typeProperties.scriptLinkedService |
Script linked service reference. |
|
| typeProperties.scriptPath |
|
Case-sensitive path to folder that contains the U-SQL script. Type: string (or Expression with resultType string). |
| userProperties |
Activity user properties. |
DatasetReference
Dataset reference type.
| Name | Type | Description |
|---|---|---|
| parameters |
|
Arguments for dataset. |
| referenceName |
string |
Reference dataset name. |
| type |
Dataset reference type. |
DatasetReferenceType
Dataset reference type.
| Value | Description |
|---|---|
| DatasetReference |
DatasetReference |
Db2Source
A copy activity source for Db2 databases.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
DeleteActivity
Delete activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Delete |
Type of activity. |
| typeProperties.dataset |
Delete activity dataset reference. |
|
| typeProperties.enableLogging |
|
Whether to record detailed logs of delete-activity execution. Default value is false. Type: boolean (or Expression with resultType boolean). |
| typeProperties.logStorageSettings |
Log storage settings customer need to provide when enableLogging is true. |
|
| typeProperties.maxConcurrentConnections |
integer (int32) minimum: 1 |
The max concurrent connections to connect data source at the same time. |
| typeProperties.recursive |
|
If true, files or sub-folders under current folder path will be deleted recursively. Default is false. Type: boolean (or Expression with resultType boolean). |
| typeProperties.storeSettings |
StoreReadSettings:
|
Delete activity store settings. |
| userProperties |
Activity user properties. |
DelimitedTextReadSettings
Delimited text read settings.
| Name | Type | Description |
|---|---|---|
| compressionProperties | CompressionReadSettings: |
Compression settings. |
| skipLineCount |
|
Indicates the number of non-empty rows to skip when reading data from input files. Type: integer (or Expression with resultType integer). |
| type | string: |
The read setting type. |
DelimitedTextSink
A copy activity DelimitedText sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
DelimitedText format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings | StoreWriteSettings: |
DelimitedText store settings. |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
DelimitedTextSource
A copy activity DelimitedText source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
DelimitedText format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings |
StoreReadSettings:
|
DelimitedText store settings. |
| type | string: |
Copy source type. |
DelimitedTextWriteSettings
Delimited text write settings.
| Name | Type | Description |
|---|---|---|
| fileExtension |
|
The file extension used to create the files. Type: string (or Expression with resultType string). |
| fileNamePrefix |
|
Specifies the file name pattern <fileNamePrefix>_<fileIndex>.<fileExtension> when copy from non-file based store without partitionOptions. Type: string (or Expression with resultType string). |
| maxRowsPerFile |
|
Limit the written file's row count to be smaller than or equal to the specified count. Type: integer (or Expression with resultType integer). |
| quoteAllText |
|
Indicates whether string values should always be enclosed with quotes. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The write setting type. |
DependencyCondition
| Value | Description |
|---|---|
| Succeeded |
Succeeded |
| Failed |
Failed |
| Skipped |
Skipped |
| Completed |
Completed |
DistcpSettings
Distcp settings.
| Name | Type | Description |
|---|---|---|
| distcpOptions |
|
Specifies the Distcp options. Type: string (or Expression with resultType string). |
| resourceManagerEndpoint |
|
Specifies the Yarn ResourceManager endpoint. Type: string (or Expression with resultType string). |
| tempScriptPath |
|
Specifies an existing folder path which will be used to store temp Distcp command script. The script file is generated by ADF and will be removed after Copy job finished. Type: string (or Expression with resultType string). |
DocumentDbCollectionSink
A copy activity Document Database Collection sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| nestingSeparator |
|
Nested properties separator. Default is . (dot). Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
Describes how to write data to Azure Cosmos DB. Type: string (or Expression with resultType string). Allowed values: insert and upsert. |
DocumentDbCollectionSource
A copy activity Document Database Collection source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| nestingSeparator |
|
Nested properties separator. Type: string (or Expression with resultType string). |
| query |
|
Documents query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
DrillSource
A copy activity Drill server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
DWCopyCommandDefaultValue
Default value.
| Name | Type | Description |
|---|---|---|
| columnName |
|
Column name. Type: object (or Expression with resultType string). |
| defaultValue |
|
The default value of the column. Type: object (or Expression with resultType string). |
DWCopyCommandSettings
DW Copy Command settings.
| Name | Type | Description |
|---|---|---|
| additionalOptions |
object |
Additional options directly passed to SQL DW in Copy Command. Type: key value pairs (value should be string type) (or Expression with resultType object). Example: "additionalOptions": { "MAXERRORS": "1000", "DATEFORMAT": "'ymd'" } |
| defaultValues |
Specifies the default values for each target column in SQL DW. The default values in the property overwrite the DEFAULT constraint set in the DB, and identity column cannot have a default value. Type: array of objects (or Expression with resultType array of objects). |
DynamicsAXSource
A copy activity Dynamics AX source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| httpRequestTimeout |
|
The timeout (TimeSpan) to get an HTTP response. It is the timeout to get a response, not the timeout to read response data. Default value: 00:05:00. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
DynamicsCrmSink
A copy activity Dynamics CRM sink.
| Name | Type | Description |
|---|---|---|
| alternateKeyName |
|
The logical name of the alternate key which will be used when upserting records. Type: string (or Expression with resultType string). |
| bypassBusinessLogicExecution |
|
Controls the bypass of Dataverse custom business logic. Type: string (or Expression with resultType string). Type: string (or Expression with resultType string). |
| bypassPowerAutomateFlows |
|
Controls the bypass of Power Automate flows. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| ignoreNullValues |
|
The flag indicating whether to ignore null values from input dataset (except key fields) during write operation. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
The write behavior for the operation. |
DynamicsCrmSource
A copy activity Dynamics CRM source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
FetchXML is a proprietary query language that is used in Microsoft Dynamics CRM (online & on-premises). Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
DynamicsSink
A copy activity Dynamics sink.
| Name | Type | Description |
|---|---|---|
| alternateKeyName |
|
The logical name of the alternate key which will be used when upserting records. Type: string (or Expression with resultType string). |
| bypassBusinessLogicExecution |
|
Controls the bypass of Dataverse custom business logic. Type: string (or Expression with resultType string). Type: string (or Expression with resultType string). |
| bypassPowerAutomateFlows |
|
Controls the bypass of Power Automate flows. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| ignoreNullValues |
|
The flag indicating whether ignore null values from input dataset (except key fields) during write operation. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
The write behavior for the operation. |
DynamicsSinkWriteBehavior
Defines values for DynamicsSinkWriteBehavior.
| Value | Description |
|---|---|
| Upsert |
Upsert |
DynamicsSource
A copy activity Dynamics source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
FetchXML is a proprietary query language that is used in Microsoft Dynamics (online & on-premises). Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
EloquaSource
A copy activity Eloqua server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
ExcelSource
A copy activity excel source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings |
StoreReadSettings:
|
Excel store settings. |
| type | string: |
Copy source type. |
ExecuteDataFlowActivity
Execute data flow activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Execute |
Type of activity. |
| typeProperties.compute |
Compute properties for data flow activity. |
|
| typeProperties.continuationSettings |
Continuation settings for execute data flow activity. |
|
| typeProperties.continueOnError |
|
Continue on error setting used for data flow execution. Enables processing to continue if a sink fails. Type: boolean (or Expression with resultType boolean) |
| typeProperties.dataFlow |
Data flow reference. |
|
| typeProperties.integrationRuntime |
The integration runtime reference. |
|
| typeProperties.runConcurrently |
|
Concurrent run setting used for data flow execution. Allows sinks with the same save order to be processed concurrently. Type: boolean (or Expression with resultType boolean) |
| typeProperties.sourceStagingConcurrency |
|
Specify number of parallel staging for sources applicable to the sink. Type: integer (or Expression with resultType integer) |
| typeProperties.staging |
Staging info for execute data flow activity. |
|
| typeProperties.traceLevel |
|
Trace level setting used for data flow monitoring output. Supported values are: 'coarse', 'fine', and 'none'. Type: string (or Expression with resultType string) |
| userProperties |
Activity user properties. |
ExecuteDataFlowActivityTypePropertiesCompute
Compute properties for data flow activity.
| Name | Type | Description |
|---|---|---|
| computeType |
|
Compute type of the cluster which will execute data flow job. Possible values include: 'General', 'MemoryOptimized', 'ComputeOptimized'. Type: string (or Expression with resultType string) |
| coreCount |
|
Core count of the cluster which will execute data flow job. Supported values are: 8, 16, 32, 48, 80, 144 and 272. Type: integer (or Expression with resultType integer) |
ExecutePipelineActivity
Execute pipeline activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Execute pipeline activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Execute |
Type of activity. |
| typeProperties.parameters |
|
Pipeline parameters. |
| typeProperties.pipeline |
Pipeline reference. |
|
| typeProperties.waitOnCompletion |
boolean |
Defines whether activity execution will wait for the dependent pipeline execution to finish. Default is false. |
| userProperties |
Activity user properties. |
ExecutePipelineActivityPolicy
Execution policy for an execute pipeline activity.
| Name | Type | Description |
|---|---|---|
| secureInput |
boolean |
When set to true, Input from activity is considered as secure and will not be logged to monitoring. |
ExecuteSSISPackageActivity
Execute SSIS package activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Execute |
Type of activity. |
| typeProperties.connectVia |
The integration runtime reference. |
|
| typeProperties.environmentPath |
|
The environment path to execute the SSIS package. Type: string (or Expression with resultType string). |
| typeProperties.executionCredential |
The package execution credential. |
|
| typeProperties.logLocation |
SSIS package execution log location. |
|
| typeProperties.loggingLevel |
|
The logging level of SSIS package execution. Type: string (or Expression with resultType string). |
| typeProperties.packageConnectionManagers |
object |
The package level connection managers to execute the SSIS package. |
| typeProperties.packageLocation |
SSIS package location. |
|
| typeProperties.packageParameters |
<string,
SSISExecution |
The package level parameters to execute the SSIS package. |
| typeProperties.projectConnectionManagers |
object |
The project level connection managers to execute the SSIS package. |
| typeProperties.projectParameters |
<string,
SSISExecution |
The project level parameters to execute the SSIS package. |
| typeProperties.propertyOverrides |
<string,
SSISProperty |
The property overrides to execute the SSIS package. |
| typeProperties.runtime |
|
Specifies the runtime to execute SSIS package. The value should be "x86" or "x64". Type: string (or Expression with resultType string). |
| userProperties |
Activity user properties. |
ExecuteWranglingDataflowActivity
Execute power query activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Execute |
Type of activity. |
| typeProperties.compute |
Compute properties for data flow activity. |
|
| typeProperties.continuationSettings |
Continuation settings for execute data flow activity. |
|
| typeProperties.continueOnError |
|
Continue on error setting used for data flow execution. Enables processing to continue if a sink fails. Type: boolean (or Expression with resultType boolean) |
| typeProperties.dataFlow |
Data flow reference. |
|
| typeProperties.integrationRuntime |
The integration runtime reference. |
|
| typeProperties.queries |
List of mapping for Power Query mashup query to sink dataset(s). |
|
| typeProperties.runConcurrently |
|
Concurrent run setting used for data flow execution. Allows sinks with the same save order to be processed concurrently. Type: boolean (or Expression with resultType boolean) |
| typeProperties.sinks |
<string,
Power |
(Deprecated. Please use Queries). List of Power Query activity sinks mapped to a queryName. |
| typeProperties.sourceStagingConcurrency |
|
Specify number of parallel staging for sources applicable to the sink. Type: integer (or Expression with resultType integer) |
| typeProperties.staging |
Staging info for execute data flow activity. |
|
| typeProperties.traceLevel |
|
Trace level setting used for data flow monitoring output. Supported values are: 'coarse', 'fine', and 'none'. Type: string (or Expression with resultType string) |
| userProperties |
Activity user properties. |
ExecutionActivity
Base class for all execution activities.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Execution |
Type of activity. |
| userProperties |
Activity user properties. |
Expression
Azure Data Factory expression definition.
| Name | Type | Description |
|---|---|---|
| type |
Expression type. |
|
| value |
string |
Expression value. |
ExpressionType
Expression type.
| Value | Description |
|---|---|
| Expression |
Expression |
ExpressionV2
Nested representation of a complex expression.
| Name | Type | Description |
|---|---|---|
| operands |
List of nested expressions. |
|
| operators |
string[] |
Expression operator value Type: list of strings. |
| type |
Type of expressions supported by the system. Type: string. |
|
| value |
|
Value for Constant/Field Type: object. |
ExpressionV2Type
Type of expressions supported by the system. Type: string.
| Value | Description |
|---|---|
| Constant |
Constant |
| Field |
Field |
| Unary |
Unary |
| Binary |
Binary |
| NAry |
NAry |
FailActivity
This activity will fail within its own scope and output a custom error message and error code. The error message and code can provided either as a string literal or as an expression that can be evaluated to a string at runtime. The activity scope can be the whole pipeline or a control activity (e.g. foreach, switch, until), if the fail activity is contained in it.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Fail |
Type of activity. |
| typeProperties.errorCode |
|
The error code that categorizes the error type of the Fail activity. It can be dynamic content that's evaluated to a non empty/blank string at runtime. Type: string (or Expression with resultType string). |
| typeProperties.message |
|
The error message that surfaced in the Fail activity. It can be dynamic content that's evaluated to a non empty/blank string at runtime. Type: string (or Expression with resultType string). |
| userProperties |
Activity user properties. |
FileServerReadSettings
File server read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileFilter |
|
Specify a filter to be used to select a subset of files in the folderPath rather than all files. Type: string (or Expression with resultType string). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
FileServer wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
FileServer wildcardFolderPath. Type: string (or Expression with resultType string). |
FileServerWriteSettings
File server write settings.
| Name | Type | Description |
|---|---|---|
| copyBehavior |
|
The type of copy behavior for copy sink. |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| metadata |
Specify the custom metadata to be added to sink data. Type: array of objects (or Expression with resultType array of objects). |
|
| type | string: |
The write setting type. |
FileSystemSink
A copy activity file system sink.
| Name | Type | Description |
|---|---|---|
| copyBehavior |
|
The type of copy behavior for copy sink. |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
FileSystemSource
A copy activity file system source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
FilterActivity
Filter and return results from input array based on the conditions.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Filter |
Type of activity. |
| typeProperties.condition |
Condition to be used for filtering the input. |
|
| typeProperties.items |
Input array on which filter should be applied. |
|
| userProperties |
Activity user properties. |
ForEachActivity
This activity is used for iterating over a collection and execute given activities.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
For |
Type of activity. |
| typeProperties.activities |
Activity[]:
|
List of activities to execute . |
| typeProperties.batchCount |
integer (int32) maximum: 50 |
Batch count to be used for controlling the number of parallel execution (when isSequential is set to false). |
| typeProperties.isSequential |
boolean |
Should the loop be executed in sequence or in parallel (max 50) |
| typeProperties.items |
Collection to iterate. |
|
| userProperties |
Activity user properties. |
FtpReadSettings
Ftp read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableChunking |
|
If true, disable parallel reading within each file. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| useBinaryTransfer |
|
Specify whether to use binary transfer mode for FTP stores. Type: boolean (or Expression with resultType boolean). |
| wildcardFileName |
|
Ftp wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
Ftp wildcardFolderPath. Type: string (or Expression with resultType string). |
GetMetadataActivity
Activity to get metadata of dataset
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Get |
Type of activity. |
| typeProperties.dataset |
GetMetadata activity dataset reference. |
|
| typeProperties.fieldList |
Get |
Fields of metadata to get from dataset. |
| typeProperties.formatSettings | FormatReadSettings: |
GetMetadata activity format settings. |
| typeProperties.storeSettings |
StoreReadSettings:
|
GetMetadata activity store settings. |
| userProperties |
Activity user properties. |
GoogleAdWordsSource
A copy activity Google AdWords service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
GoogleBigQuerySource
A copy activity Google BigQuery service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
GoogleBigQueryV2Source
A copy activity Google BigQuery service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
GoogleCloudStorageReadSettings
Google Cloud Storage read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| prefix |
|
The prefix filter for the Google Cloud Storage object name. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
Google Cloud Storage wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
Google Cloud Storage wildcardFolderPath. Type: string (or Expression with resultType string). |
GreenplumSource
A copy activity Greenplum Database source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
HBaseSource
A copy activity HBase server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
HdfsReadSettings
HDFS read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| distcpSettings |
Specifies Distcp-related settings. |
|
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
HDFS wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
HDFS wildcardFolderPath. Type: string (or Expression with resultType string). |
HdfsSource
A copy activity HDFS source.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| distcpSettings |
Specifies Distcp-related settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
HDInsightActivityDebugInfoOption
The HDInsightActivityDebugInfoOption settings to use.
| Value | Description |
|---|---|
| None |
None |
| Always |
Always |
| Failure |
Failure |
HDInsightHiveActivity
HDInsight Hive activity type.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
HDInsight |
Type of activity. |
| typeProperties.arguments |
HDInsight |
User specified arguments to HDInsightActivity. |
| typeProperties.defines |
|
Allows user to specify defines for Hive job request. |
| typeProperties.getDebugInfo |
Debug info option. |
|
| typeProperties.queryTimeout |
integer (int32) |
Query timeout value (in minutes). Effective when the HDInsight cluster is with ESP (Enterprise Security Package) |
| typeProperties.scriptLinkedService |
Script linked service reference. |
|
| typeProperties.scriptPath |
|
Script path. Type: string (or Expression with resultType string). |
| typeProperties.storageLinkedServices |
Storage linked service references. |
|
| typeProperties.variables |
|
User specified arguments under hivevar namespace. |
| userProperties |
Activity user properties. |
HDInsightMapReduceActivity
HDInsight MapReduce activity type.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
HDInsight |
Type of activity. |
| typeProperties.arguments |
HDInsight |
User specified arguments to HDInsightActivity. |
| typeProperties.className |
|
Class name. Type: string (or Expression with resultType string). |
| typeProperties.defines |
|
Allows user to specify defines for the MapReduce job request. |
| typeProperties.getDebugInfo |
Debug info option. |
|
| typeProperties.jarFilePath |
|
Jar path. Type: string (or Expression with resultType string). |
| typeProperties.jarLibs |
HDInsight |
Jar libs. |
| typeProperties.jarLinkedService |
Jar linked service reference. |
|
| typeProperties.storageLinkedServices |
Storage linked service references. |
|
| userProperties |
Activity user properties. |
HDInsightPigActivity
HDInsight Pig activity type.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
HDInsight |
Type of activity. |
| typeProperties.arguments |
|
User specified arguments to HDInsightActivity. Type: array (or Expression with resultType array). |
| typeProperties.defines |
|
Allows user to specify defines for Pig job request. |
| typeProperties.getDebugInfo |
Debug info option. |
|
| typeProperties.scriptLinkedService |
Script linked service reference. |
|
| typeProperties.scriptPath |
|
Script path. Type: string (or Expression with resultType string). |
| typeProperties.storageLinkedServices |
Storage linked service references. |
|
| userProperties |
Activity user properties. |
HDInsightSparkActivity
HDInsight Spark activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
HDInsight |
Type of activity. |
| typeProperties.arguments |
HDInsight |
The user-specified arguments to HDInsightSparkActivity. |
| typeProperties.className |
string |
The application's Java/Spark main class. |
| typeProperties.entryFilePath |
|
The relative path to the root folder of the code/package to be executed. Type: string (or Expression with resultType string). |
| typeProperties.getDebugInfo |
Debug info option. |
|
| typeProperties.proxyUser |
|
The user to impersonate that will execute the job. Type: string (or Expression with resultType string). |
| typeProperties.rootPath |
|
The root path in 'sparkJobLinkedService' for all the job’s files. Type: string (or Expression with resultType string). |
| typeProperties.sparkConfig |
|
Spark configuration property. |
| typeProperties.sparkJobLinkedService |
The storage linked service for uploading the entry file and dependencies, and for receiving logs. |
|
| userProperties |
Activity user properties. |
HDInsightStreamingActivity
HDInsight streaming activity type.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
HDInsight |
Type of activity. |
| typeProperties.arguments |
HDInsight |
User specified arguments to HDInsightActivity. |
| typeProperties.combiner |
|
Combiner executable name. Type: string (or Expression with resultType string). |
| typeProperties.commandEnvironment |
HDInsight |
Command line environment values. |
| typeProperties.defines |
|
Allows user to specify defines for streaming job request. |
| typeProperties.fileLinkedService |
Linked service reference where the files are located. |
|
| typeProperties.filePaths |
HDInsight |
Paths to streaming job files. Can be directories. |
| typeProperties.getDebugInfo |
Debug info option. |
|
| typeProperties.input |
|
Input blob path. Type: string (or Expression with resultType string). |
| typeProperties.mapper |
|
Mapper executable name. Type: string (or Expression with resultType string). |
| typeProperties.output |
|
Output blob path. Type: string (or Expression with resultType string). |
| typeProperties.reducer |
|
Reducer executable name. Type: string (or Expression with resultType string). |
| typeProperties.storageLinkedServices |
Storage linked service references. |
|
| userProperties |
Activity user properties. |
HiveSource
A copy activity Hive Server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
HttpReadSettings
Http read settings.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| additionalHeaders |
|
The additional HTTP headers in the request to the RESTful API. Type: string (or Expression with resultType string). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| requestBody |
|
The HTTP request body to the RESTful API if requestMethod is POST. Type: string (or Expression with resultType string). |
| requestMethod |
|
The HTTP method used to call the RESTful API. The default is GET. Type: string (or Expression with resultType string). |
| requestTimeout |
|
Specifies the timeout for a HTTP client to get HTTP response from HTTP server. Type: string (or Expression with resultType string). |
| type | string: |
The read setting type. |
HttpSource
A copy activity source for an HTTP file.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| httpRequestTimeout |
|
Specifies the timeout for a HTTP client to get HTTP response from HTTP server. The default value is equivalent to System.Net.HttpWebRequest.Timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
HubspotSource
A copy activity Hubspot Service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
IcebergSink
A copy activity Iceberg sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
Iceberg format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings | StoreWriteSettings: |
Iceberg store settings. |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
IcebergWriteSettings
Iceberg write settings.
| Name | Type | Description |
|---|---|---|
| type | string: |
The write setting type. |
IfConditionActivity
This activity evaluates a boolean expression and executes either the activities under the ifTrueActivities property or the ifFalseActivities property depending on the result of the expression.
ImpalaSource
A copy activity Impala server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
InformixSink
A copy activity Informix sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
A query to execute before starting the copy. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
InformixSource
A copy activity source for Informix.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
IntegrationRuntimeReference
Integration runtime reference type.
| Name | Type | Description |
|---|---|---|
| parameters |
|
Arguments for integration runtime. |
| referenceName |
string |
Reference integration runtime name. |
| type |
Type of integration runtime. |
IntegrationRuntimeReferenceType
Type of integration runtime.
| Value | Description |
|---|---|
| IntegrationRuntimeReference |
IntegrationRuntimeReference |
JiraSource
A copy activity Jira Service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
JsonReadSettings
Json read settings.
| Name | Type | Description |
|---|---|---|
| compressionProperties | CompressionReadSettings: |
Compression settings. |
| type | string: |
The read setting type. |
JsonSink
A copy activity Json sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
Json format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings | StoreWriteSettings: |
Json store settings. |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
JsonSource
A copy activity Json source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
Json format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings |
StoreReadSettings:
|
Json store settings. |
| type | string: |
Copy source type. |
JsonWriteSettings
Json write settings.
| Name | Type | Description |
|---|---|---|
| filePattern |
|
File pattern of JSON. This setting controls the way a collection of JSON objects will be treated. The default value is 'setOfObjects'. It is case-sensitive. |
| type | string: |
The write setting type. |
LakeHouseReadSettings
Microsoft Fabric Lakehouse Files read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
Microsoft Fabric Lakehouse Files wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
Microsoft Fabric Lakehouse Files wildcardFolderPath. Type: string (or Expression with resultType string). |
LakeHouseTableSink
A copy activity for Microsoft Fabric Lakehouse Table sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| partitionNameList |
|
Specify the partition column names from sink columns. Type: array of objects (or Expression with resultType array of objects). |
| partitionOption |
|
Create partitions in folder structure based on one or multiple columns. Each distinct column value (pair) will be a new partition. Possible values include: "None", "PartitionByKey". |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| tableActionOption |
|
The type of table action for Lakehouse Table sink. Possible values include: "None", "Append", "Overwrite". |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
LakeHouseTableSource
A copy activity source for Microsoft Fabric Lakehouse Table.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| timestampAsOf |
|
Query an older snapshot by timestamp. Type: string (or Expression with resultType string). |
| type | string: |
Copy source type. |
| versionAsOf |
|
Query an older snapshot by version. Type: integer (or Expression with resultType integer). |
LakeHouseWriteSettings
Microsoft Fabric Lakehouse Files write settings.
| Name | Type | Description |
|---|---|---|
| copyBehavior |
|
The type of copy behavior for copy sink. |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| metadata |
Specify the custom metadata to be added to sink data. Type: array of objects (or Expression with resultType array of objects). |
|
| type | string: |
The write setting type. |
LinkedServiceReference
Linked service reference type.
| Name | Type | Description |
|---|---|---|
| parameters |
|
Arguments for LinkedService. |
| referenceName |
string |
Reference LinkedService name. |
| type |
Linked service reference type. |
LogLocationSettings
Log location settings.
| Name | Type | Description |
|---|---|---|
| linkedServiceName |
Log storage linked service reference. |
|
| path |
|
The path to storage for storing detailed logs of activity execution. Type: string (or Expression with resultType string). |
LogSettings
Log settings.
| Name | Type | Description |
|---|---|---|
| copyActivityLogSettings |
Specifies settings for copy activity log. |
|
| enableCopyActivityLog |
|
Specifies whether to enable copy activity log. Type: boolean (or Expression with resultType boolean). |
| logLocationSettings |
Log location settings customer needs to provide when enabling log. |
LogStorageSettings
(Deprecated. Please use LogSettings) Log storage settings.
| Name | Type | Description |
|---|---|---|
| enableReliableLogging |
|
Specifies whether to enable reliable logging. Type: boolean (or Expression with resultType boolean). |
| linkedServiceName |
Log storage linked service reference. |
|
| logLevel |
|
Gets or sets the log level, support: Info, Warning. Type: string (or Expression with resultType string). |
| path |
|
The path to storage for storing detailed logs of activity execution. Type: string (or Expression with resultType string). |
LookupActivity
Lookup activity.
MagentoSource
A copy activity Magento server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
MariaDBSource
A copy activity MariaDB server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
MarketoSource
A copy activity Marketo server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
MetadataItem
Specify the name and value of custom metadata item.
| Name | Type | Description |
|---|---|---|
| name |
|
Metadata item key name. Type: string (or Expression with resultType string). |
| value |
|
Metadata item value. Type: string (or Expression with resultType string). |
MicrosoftAccessSink
A copy activity Microsoft Access sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
A query to execute before starting the copy. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
MicrosoftAccessSource
A copy activity source for Microsoft Access.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
MongoDbAtlasSink
A copy activity MongoDB Atlas sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
Specifies whether the document with same key to be overwritten (upsert) rather than throw exception (insert). The default value is "insert". Type: string (or Expression with resultType string). Type: string (or Expression with resultType string). |
MongoDbAtlasSource
A copy activity source for a MongoDB Atlas database.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| batchSize |
|
Specifies the number of documents to return in each batch of the response from MongoDB Atlas instance. In most cases, modifying the batch size will not affect the user or the application. This property's main purpose is to avoid hit the limitation of response size. Type: integer (or Expression with resultType integer). |
| cursorMethods |
Cursor methods for Mongodb query |
|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| filter |
|
Specifies selection filter using query operators. To return all documents in a collection, omit this parameter or pass an empty document ({}). Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
MongoDbCursorMethodsProperties
Cursor methods for Mongodb query
| Name | Type | Description |
|---|---|---|
| limit |
|
Specifies the maximum number of documents the server returns. limit() is analogous to the LIMIT statement in a SQL database. Type: integer (or Expression with resultType integer). |
| project |
|
Specifies the fields to return in the documents that match the query filter. To return all fields in the matching documents, omit this parameter. Type: string (or Expression with resultType string). |
| skip |
|
Specifies the how many documents skipped and where MongoDB begins returning results. This approach may be useful in implementing paginated results. Type: integer (or Expression with resultType integer). |
| sort |
|
Specifies the order in which the query returns matching documents. Type: string (or Expression with resultType string). Type: string (or Expression with resultType string). |
MongoDbSource
A copy activity source for a MongoDB database.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Should be a SQL-92 query expression. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
MongoDbV2Sink
A copy activity MongoDB sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
Specifies whether the document with same key to be overwritten (upsert) rather than throw exception (insert). The default value is "insert". Type: string (or Expression with resultType string). Type: string (or Expression with resultType string). |
MongoDbV2Source
A copy activity source for a MongoDB database.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| batchSize |
|
Specifies the number of documents to return in each batch of the response from MongoDB instance. In most cases, modifying the batch size will not affect the user or the application. This property's main purpose is to avoid hit the limitation of response size. Type: integer (or Expression with resultType integer). |
| cursorMethods |
Cursor methods for Mongodb query |
|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| filter |
|
Specifies selection filter using query operators. To return all documents in a collection, omit this parameter or pass an empty document ({}). Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
MySqlSource
A copy activity source for MySQL databases.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
NetezzaPartitionSettings
The settings that will be leveraged for Netezza source partitioning.
| Name | Type | Description |
|---|---|---|
| partitionColumnName |
|
The name of the column in integer type that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
| partitionLowerBound |
|
The minimum value of column specified in partitionColumnName that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
| partitionUpperBound |
|
The maximum value of column specified in partitionColumnName that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
NetezzaSource
A copy activity Netezza source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for Netezza read in parallel. Possible values include: "None", "DataSlice", "DynamicRange". |
| partitionSettings |
The settings that will be leveraged for Netezza source partitioning. |
|
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
NotebookParameter
Notebook parameter.
| Name | Type | Description |
|---|---|---|
| type |
Notebook parameter type. |
|
| value |
|
Notebook parameter value. Type: string (or Expression with resultType string). |
NotebookParameterType
Notebook parameter type.
| Value | Description |
|---|---|
| string |
string |
| int |
int |
| float |
float |
| bool |
bool |
NotebookReferenceType
Synapse notebook reference type.
| Value | Description |
|---|---|
| NotebookReference |
NotebookReference |
ODataSource
A copy activity source for OData source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| httpRequestTimeout |
|
The timeout (TimeSpan) to get an HTTP response. It is the timeout to get a response, not the timeout to read response data. Default value: 00:05:00. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
OData query. For example, "$top=1". Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
OdbcSink
A copy activity ODBC sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
A query to execute before starting the copy. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
OdbcSource
A copy activity source for ODBC databases.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
Office365Source
A copy activity source for an Office 365 service.
| Name | Type | Description |
|---|---|---|
| allowedGroups |
|
The groups containing all the users. Type: array of strings (or Expression with resultType array of strings). |
| dateFilterColumn |
|
The Column to apply the <paramref name="StartTime"/> and <paramref name="EndTime"/>. Type: string (or Expression with resultType string). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| endTime |
|
End time of the requested range for this dataset. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| outputColumns |
|
The columns to be read out from the Office 365 table. Type: array of objects (or Expression with resultType array of objects). itemType: OutputColumn. Example: [ { "name": "Id" }, { "name": "CreatedDateTime" } ] |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| startTime |
|
Start time of the requested range for this dataset. Type: string (or Expression with resultType string). |
| type | string: |
Copy source type. |
| userScopeFilterUri |
|
The user scope uri. Type: string (or Expression with resultType string). |
OracleCloudStorageReadSettings
Oracle Cloud Storage read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| prefix |
|
The prefix filter for the Oracle Cloud Storage object name. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
Oracle Cloud Storage wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
Oracle Cloud Storage wildcardFolderPath. Type: string (or Expression with resultType string). |
OraclePartitionSettings
The settings that will be leveraged for Oracle source partitioning.
| Name | Type | Description |
|---|---|---|
| partitionColumnName |
|
The name of the column in integer type that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
| partitionLowerBound |
|
The minimum value of column specified in partitionColumnName that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
| partitionNames |
|
Names of the physical partitions of Oracle table. |
| partitionUpperBound |
|
The maximum value of column specified in partitionColumnName that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
OracleServiceCloudSource
A copy activity Oracle Service Cloud source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
OracleSink
A copy activity Oracle sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
SQL pre-copy script. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
OracleSource
A copy activity Oracle source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| numberPrecision |
|
The decimal precision used to represent Oracle NUMBER type without precision and scale. The range is 1 to 256 and default value is 256 if not specified. Type: integer (or Expression with resultType integer). Only used for Version 2.0. |
| numberScale |
|
The decimal scale used to represent Oracle NUMBER type without precision and scale. The range is 0 to 130 and default value is 130 if not specified. Type: integer (or Expression with resultType integer). Only used for Version 2.0. |
| oracleReaderQuery |
|
Oracle reader query. Type: string (or Expression with resultType string). |
| partitionOption |
|
The partition mechanism that will be used for Oracle read in parallel. Possible values include: "None", "PhysicalPartitionsOfTable", "DynamicRange". |
| partitionSettings |
The settings that will be leveraged for Oracle source partitioning. |
|
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
OrcSink
A copy activity ORC sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
ORC format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings | StoreWriteSettings: |
ORC store settings. |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
OrcSource
A copy activity ORC source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings |
StoreReadSettings:
|
ORC store settings. |
| type | string: |
Copy source type. |
OrcWriteSettings
Orc write settings.
| Name | Type | Description |
|---|---|---|
| fileNamePrefix |
|
Specifies the file name pattern <fileNamePrefix>_<fileIndex>.<fileExtension> when copy from non-file based store without partitionOptions. Type: string (or Expression with resultType string). |
| maxRowsPerFile |
|
Limit the written file's row count to be smaller than or equal to the specified count. Type: integer (or Expression with resultType integer). |
| type | string: |
The write setting type. |
ParameterSpecification
Definition of a single parameter for an entity.
| Name | Type | Description |
|---|---|---|
| defaultValue |
|
Default value of parameter. |
| type |
Parameter type. |
ParameterType
Parameter type.
| Value | Description |
|---|---|
| Object |
Object |
| String |
String |
| Int |
Int |
| Float |
Float |
| Bool |
Bool |
| Array |
Array |
| SecureString |
SecureString |
ParquetReadSettings
Parquet read settings.
| Name | Type | Description |
|---|---|---|
| compressionProperties | CompressionReadSettings: |
Compression settings. |
| type | string: |
The read setting type. |
ParquetSink
A copy activity Parquet sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
Parquet format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings | StoreWriteSettings: |
Parquet store settings. |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
ParquetSource
A copy activity Parquet source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
Parquet format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings |
StoreReadSettings:
|
Parquet store settings. |
| type | string: |
Copy source type. |
ParquetWriteSettings
Parquet write settings.
| Name | Type | Description |
|---|---|---|
| fileNamePrefix |
|
Specifies the file name pattern <fileNamePrefix>_<fileIndex>.<fileExtension> when copy from non-file based store without partitionOptions. Type: string (or Expression with resultType string). |
| maxRowsPerFile |
|
Limit the written file's row count to be smaller than or equal to the specified count. Type: integer (or Expression with resultType integer). |
| type | string: |
The write setting type. |
PaypalSource
A copy activity Paypal Service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
PhoenixSource
A copy activity Phoenix server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
PipelineElapsedTimeMetricPolicy
Pipeline ElapsedTime Metric Policy.
| Name | Type | Description |
|---|---|---|
| duration |
|
TimeSpan value, after which an Azure Monitoring Metric is fired. |
PipelineFolder
The folder that this Pipeline is in. If not specified, Pipeline will appear at the root level.
| Name | Type | Description |
|---|---|---|
| name |
string |
The name of the folder that this Pipeline is in. |
PipelinePolicy
Pipeline Policy.
| Name | Type | Description |
|---|---|---|
| elapsedTimeMetric |
Pipeline ElapsedTime Metric Policy. |
PipelineReference
Pipeline reference type.
| Name | Type | Description |
|---|---|---|
| name |
string |
Reference name. |
| referenceName |
string |
Reference pipeline name. |
| type |
Pipeline reference type. |
PipelineReferenceType
Pipeline reference type.
| Value | Description |
|---|---|
| PipelineReference |
PipelineReference |
PipelineResource
Pipeline resource type.
| Name | Type | Description |
|---|---|---|
| etag |
string |
"If etag is provided in the response body, it may also be provided as a header per the normal etag convention. Entity tags are used for comparing two or more entities from the same requested resource. HTTP/1.1 uses entity tags in the etag (section 14.19), If-Match (section 14.24), If-None-Match (section 14.26), and If-Range (section 14.27) header fields.") |
| id |
string (arm-id) |
Fully qualified resource ID for the resource. E.g. "/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/{resourceProviderNamespace}/{resourceType}/{resourceName}" |
| name |
string |
The name of the resource |
| properties.activities |
Activity[]:
|
List of activities in pipeline. |
| properties.annotations |
Pipeline. |
List of tags that can be used for describing the Pipeline. |
| properties.concurrency |
integer (int32) minimum: 1 |
The max number of concurrent runs for the pipeline. |
| properties.description |
string |
The description of the pipeline. |
| properties.folder |
The folder that this Pipeline is in. If not specified, Pipeline will appear at the root level. |
|
| properties.parameters |
<string,
Parameter |
List of parameters for pipeline. |
| properties.policy |
Pipeline Policy. |
|
| properties.runDimensions |
|
Dimensions emitted by Pipeline. |
| properties.variables |
<string,
Variable |
List of variables for pipeline. |
| systemData |
Azure Resource Manager metadata containing createdBy and modifiedBy information. |
|
| type |
string |
The type of the resource. E.g. "Microsoft.Compute/virtualMachines" or "Microsoft.Storage/storageAccounts" |
PolybaseSettings
PolyBase settings.
| Name | Type | Description |
|---|---|---|
| rejectSampleValue |
|
Determines the number of rows to attempt to retrieve before the PolyBase recalculates the percentage of rejected rows. Type: integer (or Expression with resultType integer), minimum: 0. |
| rejectType |
Reject type. |
|
| rejectValue |
|
Specifies the value or the percentage of rows that can be rejected before the query fails. Type: number (or Expression with resultType number), minimum: 0. |
| useTypeDefault |
|
Specifies how to handle missing values in delimited text files when PolyBase retrieves data from the text file. Type: boolean (or Expression with resultType boolean). |
PolybaseSettingsRejectType
Indicates whether the RejectValue property is specified as a literal value or a percentage.
| Value | Description |
|---|---|
| value |
value |
| percentage |
percentage |
PostgreSqlSource
A copy activity source for PostgreSQL databases.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
PostgreSqlV2Source
A copy activity source for PostgreSQL databases.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
PowerQuerySink
Power query sink.
| Name | Type | Description |
|---|---|---|
| dataset |
Dataset reference. |
|
| description |
string |
Transformation description. |
| flowlet |
Flowlet Reference |
|
| linkedService |
Linked service reference. |
|
| name |
string |
Transformation name. |
| rejectedDataLinkedService |
Rejected data linked service reference. |
|
| schemaLinkedService |
Schema linked service reference. |
|
| script |
string |
sink script. |
PowerQuerySinkMapping
Map Power Query mashup query to sink dataset(s).
| Name | Type | Description |
|---|---|---|
| dataflowSinks |
List of sinks mapped to Power Query mashup query. |
|
| queryName |
string |
Name of the query in Power Query mashup document. |
PrestoSource
A copy activity Presto server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
QuickBooksSource
A copy activity QuickBooks server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
RedirectIncompatibleRowSettings
Redirect incompatible row settings
| Name | Type | Description |
|---|---|---|
| linkedServiceName |
|
Name of the Azure Storage, Storage SAS, or Azure Data Lake Store linked service used for redirecting incompatible row. Must be specified if redirectIncompatibleRowSettings is specified. Type: string (or Expression with resultType string). |
| path |
|
The path for storing the redirect incompatible row data. Type: string (or Expression with resultType string). |
RedshiftUnloadSettings
The Amazon S3 settings needed for the interim Amazon S3 when copying from Amazon Redshift with unload. With this, data from Amazon Redshift source will be unloaded into S3 first and then copied into the targeted sink from the interim S3.
| Name | Type | Description |
|---|---|---|
| bucketName |
|
The bucket of the interim Amazon S3 which will be used to store the unloaded data from Amazon Redshift source. The bucket must be in the same region as the Amazon Redshift source. Type: string (or Expression with resultType string). |
| s3LinkedServiceName |
The name of the Amazon S3 linked service which will be used for the unload operation when copying from the Amazon Redshift source. |
RelationalSource
A copy activity source for various relational databases.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
ResponsysSource
A copy activity Responsys source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
RestSink
A copy activity Rest service Sink.
| Name | Type | Description |
|---|---|---|
| additionalHeaders |
|
The additional HTTP headers in the request to the RESTful API. Type: key value pairs (value should be string type). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| httpCompressionType |
|
Http Compression Type to Send data in compressed format with Optimal Compression Level, Default is None. And The Only Supported option is Gzip. Type: string (or Expression with resultType string). |
| httpRequestTimeout |
|
The timeout (TimeSpan) to get an HTTP response. It is the timeout to get a response, not the timeout to read response data. Default value: 00:01:40. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| requestInterval |
|
The time to await before sending next request, in milliseconds |
| requestMethod |
|
The HTTP method used to call the RESTful API. The default is POST. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
RestSource
A copy activity Rest service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: key value pairs (value should be string type). |
| additionalHeaders |
|
The additional HTTP headers in the request to the RESTful API. Type: string (or Expression with resultType string). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| httpRequestTimeout |
|
The timeout (TimeSpan) to get an HTTP response. It is the timeout to get a response, not the timeout to read response data. Default value: 00:01:40. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| paginationRules |
|
The pagination rules to compose next page requests. Type: string (or Expression with resultType string). |
| requestBody |
|
The HTTP request body to the RESTful API if requestMethod is POST. Type: string (or Expression with resultType string). |
| requestInterval |
|
The time to await before sending next page request. |
| requestMethod |
|
The HTTP method used to call the RESTful API. The default is GET. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SalesforceMarketingCloudSource
A copy activity Salesforce Marketing Cloud source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SalesforceServiceCloudSink
A copy activity Salesforce Service Cloud sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| externalIdFieldName |
|
The name of the external ID field for upsert operation. Default value is 'Id' column. Type: string (or Expression with resultType string). |
| ignoreNullValues |
|
The flag indicating whether or not to ignore null values from input dataset (except key fields) during write operation. Default value is false. If set it to true, it means ADF will leave the data in the destination object unchanged when doing upsert/update operation and insert defined default value when doing insert operation, versus ADF will update the data in the destination object to NULL when doing upsert/update operation and insert NULL value when doing insert operation. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
The write behavior for the operation. Default is Insert. |
SalesforceServiceCloudSource
A copy activity Salesforce Service Cloud source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| readBehavior |
|
The read behavior for the operation. Default is Query. Allowed values: Query/QueryAll. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SalesforceServiceCloudV2Sink
A copy activity Salesforce Service Cloud V2 sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| externalIdFieldName |
|
The name of the external ID field for upsert operation. Default value is 'Id' column. Type: string (or Expression with resultType string). |
| ignoreNullValues |
|
The flag indicating whether or not to ignore null values from input dataset (except key fields) during write operation. Default value is false. If set it to true, it means ADF will leave the data in the destination object unchanged when doing upsert/update operation and insert defined default value when doing insert operation, versus ADF will update the data in the destination object to NULL when doing upsert/update operation and insert NULL value when doing insert operation. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
The write behavior for the operation. Default is Insert. |
SalesforceServiceCloudV2Source
A copy activity Salesforce Service Cloud V2 source.
| Name | Type | Description |
|---|---|---|
| SOQLQuery |
|
Deprecating, please use 'query' property instead. Type: string (or Expression with resultType string). |
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| includeDeletedObjects |
|
This property control whether query result contains Deleted objects. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
You can only use Salesforce Object Query Language (SOQL) query with limitations. For SOQL limitations, see this article: https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/queries.htm#SOQL%20Considerations. If query is not specified, all the data of the Salesforce object specified in ObjectApiName/reportId in dataset will be retrieved. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SalesforceSink
A copy activity Salesforce sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| externalIdFieldName |
|
The name of the external ID field for upsert operation. Default value is 'Id' column. Type: string (or Expression with resultType string). |
| ignoreNullValues |
|
The flag indicating whether or not to ignore null values from input dataset (except key fields) during write operation. Default value is false. If set it to true, it means ADF will leave the data in the destination object unchanged when doing upsert/update operation and insert defined default value when doing insert operation, versus ADF will update the data in the destination object to NULL when doing upsert/update operation and insert NULL value when doing insert operation. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
The write behavior for the operation. Default is Insert. |
SalesforceSinkWriteBehavior
The write behavior for the operation. Default is Insert.
| Value | Description |
|---|---|
| Insert |
Insert |
| Upsert |
Upsert |
SalesforceSource
A copy activity Salesforce source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| readBehavior |
|
The read behavior for the operation. Default is Query. Allowed values: Query/QueryAll. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SalesforceV2Sink
A copy activity Salesforce V2 sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| externalIdFieldName |
|
The name of the external ID field for upsert operation. Default value is 'Id' column. Type: string (or Expression with resultType string). |
| ignoreNullValues |
|
The flag indicating whether or not to ignore null values from input dataset (except key fields) during write operation. Default value is false. If set it to true, it means ADF will leave the data in the destination object unchanged when doing upsert/update operation and insert defined default value when doing insert operation, versus ADF will update the data in the destination object to NULL when doing upsert/update operation and insert NULL value when doing insert operation. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
The write behavior for the operation. Default is Insert. |
SalesforceV2SinkWriteBehavior
The write behavior for the operation. Default is Insert.
| Value | Description |
|---|---|
| Insert |
Insert |
| Upsert |
Upsert |
SalesforceV2Source
A copy activity Salesforce V2 source.
| Name | Type | Description |
|---|---|---|
| SOQLQuery |
|
Deprecating, please use 'query' property instead. Type: string (or Expression with resultType string). |
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| includeDeletedObjects |
|
This property control whether query result contains Deleted objects. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| pageSize |
|
Page size for each http request, too large pageSize will caused timeout, default 300,000. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
Partition option for the SalesforceV2 connector in copy activity, AutoDetect or None. Type: string (or Expression with resultType string). |
| query |
|
You can only use Salesforce Object Query Language (SOQL) query with limitations. For SOQL limitations, see this article: https://developer.salesforce.com/docs/atlas.en-us.api_asynch.meta/api_asynch/queries.htm#SOQL%20Considerations. If query is not specified, all the data of the Salesforce object specified in ObjectApiName/reportId in dataset will be retrieved. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SapBwSource
A copy activity source for SapBW server via MDX.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
MDX query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SapCloudForCustomerSink
A copy activity SAP Cloud for Customer sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| httpRequestTimeout |
|
The timeout (TimeSpan) to get an HTTP response. It is the timeout to get a response, not the timeout to read response data. Default value: 00:05:00. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
The write behavior for the operation. Default is 'Insert'. |
SapCloudForCustomerSinkWriteBehavior
The write behavior for the operation. Default is 'Insert'.
| Value | Description |
|---|---|
| Insert |
Insert |
| Update |
Update |
SapCloudForCustomerSource
A copy activity source for SAP Cloud for Customer source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| httpRequestTimeout |
|
The timeout (TimeSpan) to get an HTTP response. It is the timeout to get a response, not the timeout to read response data. Default value: 00:05:00. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
SAP Cloud for Customer OData query. For example, "$top=1". Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SapEccSource
A copy activity source for SAP ECC source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| httpRequestTimeout |
|
The timeout (TimeSpan) to get an HTTP response. It is the timeout to get a response, not the timeout to read response data. Default value: 00:05:00. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
SAP ECC OData query. For example, "$top=1". Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SapHanaPartitionSettings
The settings that will be leveraged for SAP HANA source partitioning.
| Name | Type | Description |
|---|---|---|
| partitionColumnName |
|
The name of the column that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
SapHanaSource
A copy activity source for SAP HANA source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| packetSize |
|
The packet size of data read from SAP HANA. Type: integer(or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for SAP HANA read in parallel. Possible values include: "None", "PhysicalPartitionsOfTable", "SapHanaDynamicRange". |
| partitionSettings |
The settings that will be leveraged for SAP HANA source partitioning. |
|
| query |
|
SAP HANA Sql query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SapOdpSource
A copy activity source for SAP ODP source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| extractionMode |
|
The extraction mode. Allowed value include: Full, Delta and Recovery. The default value is Full. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| projection |
|
Specifies the columns to be selected from source data. Type: array of objects(projection) (or Expression with resultType array of objects). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| selection |
|
Specifies the selection conditions from source data. Type: array of objects(selection) (or Expression with resultType array of objects). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| subscriberProcess |
|
The subscriber process to manage the delta process. Type: string (or Expression with resultType string). |
| type | string: |
Copy source type. |
SapOpenHubSource
A copy activity source for SAP Business Warehouse Open Hub Destination source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| baseRequestId |
|
The ID of request for delta loading. Once it is set, only data with requestId larger than the value of this property will be retrieved. The default value is 0. Type: integer (or Expression with resultType integer ). |
| customRfcReadTableFunctionModule |
|
Specifies the custom RFC function module that will be used to read data from SAP Table. Type: string (or Expression with resultType string). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| excludeLastRequest |
|
Whether to exclude the records of the last request. The default value is true. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sapDataColumnDelimiter |
|
The single character that will be used as delimiter passed to SAP RFC as well as splitting the output data retrieved. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SapTablePartitionSettings
The settings that will be leveraged for SAP table source partitioning.
| Name | Type | Description |
|---|---|---|
| maxPartitionsNumber |
|
The maximum value of partitions the table will be split into. Type: integer (or Expression with resultType string). |
| partitionColumnName |
|
The name of the column that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
| partitionLowerBound |
|
The minimum value of column specified in partitionColumnName that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
| partitionUpperBound |
|
The maximum value of column specified in partitionColumnName that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
SapTableSource
A copy activity source for SAP Table source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| batchSize |
|
Specifies the maximum number of rows that will be retrieved at a time when retrieving data from SAP Table. Type: integer (or Expression with resultType integer). |
| customRfcReadTableFunctionModule |
|
Specifies the custom RFC function module that will be used to read data from SAP Table. Type: string (or Expression with resultType string). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for SAP table read in parallel. Possible values include: "None", "PartitionOnInt", "PartitionOnCalendarYear", "PartitionOnCalendarMonth", "PartitionOnCalendarDate", "PartitionOnTime". |
| partitionSettings |
The settings that will be leveraged for SAP table source partitioning. |
|
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| rfcTableFields |
|
The fields of the SAP table that will be retrieved. For example, column0, column1. Type: string (or Expression with resultType string). |
| rfcTableOptions |
|
The options for the filtering of the SAP Table. For example, COLUMN0 EQ SOME VALUE. Type: string (or Expression with resultType string). |
| rowCount |
|
The number of rows to be retrieved. Type: integer(or Expression with resultType integer). |
| rowSkips |
|
The number of rows that will be skipped. Type: integer (or Expression with resultType integer). |
| sapDataColumnDelimiter |
|
The single character that will be used as delimiter passed to SAP RFC as well as splitting the output data retrieved. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
ScriptActivity
Script activity type.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Script |
Type of activity. |
| typeProperties.logSettings |
Log settings of script activity. |
|
| typeProperties.returnMultistatementResult |
|
Enable to retrieve result sets from multiple SQL statements and the number of rows affected by the DML statement. Supported connector: SnowflakeV2. Type: boolean (or Expression with resultType boolean). |
| typeProperties.scriptBlockExecutionTimeout |
|
ScriptBlock execution timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| typeProperties.scripts |
Array of script blocks. Type: array. |
|
| typeProperties.treatDecimalAsString |
|
Indicates whether to treat decimal values as strings to avoid value overflow issue. This option is enabled for SnowflakeV2 connector only. Type: boolean (or Expression with resultType boolean). |
| userProperties |
Activity user properties. |
ScriptActivityLogDestination
The destination of logs. Type: string.
| Value | Description |
|---|---|
| ActivityOutput |
ActivityOutput |
| ExternalStore |
ExternalStore |
ScriptActivityParameter
Parameters of a script block.
| Name | Type | Description |
|---|---|---|
| direction |
The direction of the parameter. |
|
| name |
|
The name of the parameter. Type: string (or Expression with resultType string). |
| size |
integer (int32) |
The size of the output direction parameter. |
| type |
The type of the parameter. |
|
| value |
|
The value of the parameter. Type: string (or Expression with resultType string). |
ScriptActivityParameterDirection
The direction of the parameter.
| Value | Description |
|---|---|
| Input |
Input |
| Output |
Output |
| InputOutput |
InputOutput |
ScriptActivityParameterType
The type of the parameter.
| Value | Description |
|---|---|
| Boolean |
Boolean |
| DateTime |
DateTime |
| DateTimeOffset |
DateTimeOffset |
| Decimal |
Decimal |
| Double |
Double |
| Guid |
Guid |
| Int16 |
Int16 |
| Int32 |
Int32 |
| Int64 |
Int64 |
| Single |
Single |
| String |
String |
| Timespan |
Timespan |
ScriptActivityScriptBlock
Script block of scripts.
| Name | Type | Description |
|---|---|---|
| parameters |
Array of script parameters. Type: array. |
|
| text |
|
The query text. Type: string (or Expression with resultType string). |
| type |
|
The type of the query. Please refer to the ScriptType for valid options. Type: string (or Expression with resultType string). |
ScriptActivityTypePropertiesLogSettings
Log settings of script activity.
| Name | Type | Description |
|---|---|---|
| logDestination |
The destination of logs. Type: string. |
|
| logLocationSettings |
Log location settings customer needs to provide when enabling log. |
SecureInputOutputPolicy
Execution policy for an activity that supports secure input and output.
| Name | Type | Description |
|---|---|---|
| secureInput |
boolean |
When set to true, Input from activity is considered as secure and will not be logged to monitoring. |
| secureOutput |
boolean |
When set to true, Output from activity is considered as secure and will not be logged to monitoring. |
SecureString
Azure Data Factory secure string definition. The string value will be masked with asterisks '*' during Get or List API calls.
| Name | Type | Description |
|---|---|---|
| type | string: |
Type of the secret. |
| value |
string |
Value of secure string. |
ServiceNowSource
A copy activity ServiceNow server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
ServiceNowV2Source
A copy activity ServiceNowV2 server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| expression |
Expression to filter data from source. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| pageSize |
|
Page size of the result. Type: integer (or Expression with resultType integer). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SetVariableActivity
Set value for a Variable.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Set |
Type of activity. |
| typeProperties.setSystemVariable |
boolean |
If set to true, it sets the pipeline run return value. |
| typeProperties.value |
|
Value to be set. Could be a static value or Expression. |
| typeProperties.variableName |
string |
Name of the variable whose value needs to be set. |
| userProperties |
Activity user properties. |
SftpReadSettings
Sftp read settings.
| Name | Type | Description |
|---|---|---|
| deleteFilesAfterCompletion |
|
Indicates whether the source files need to be deleted after copy completion. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableChunking |
|
If true, disable parallel reading within each file. Default is false. Type: boolean (or Expression with resultType boolean). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| enablePartitionDiscovery |
|
Indicates whether to enable partition discovery. Type: boolean (or Expression with resultType boolean). |
| fileListPath |
|
Point to a text file that lists each file (relative path to the path configured in the dataset) that you want to copy. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| modifiedDatetimeEnd |
|
The end of file's modified datetime. Type: string (or Expression with resultType string). |
| modifiedDatetimeStart |
|
The start of file's modified datetime. Type: string (or Expression with resultType string). |
| partitionRootPath |
|
Specify the root path where partition discovery starts from. Type: string (or Expression with resultType string). |
| recursive |
|
If true, files under the folder path will be read recursively. Default is true. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| wildcardFileName |
|
Sftp wildcardFileName. Type: string (or Expression with resultType string). |
| wildcardFolderPath |
|
Sftp wildcardFolderPath. Type: string (or Expression with resultType string). |
SftpWriteSettings
Sftp write settings.
| Name | Type | Description |
|---|---|---|
| copyBehavior |
|
The type of copy behavior for copy sink. |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| metadata |
Specify the custom metadata to be added to sink data. Type: array of objects (or Expression with resultType array of objects). |
|
| operationTimeout |
|
Specifies the timeout for writing each chunk to SFTP server. Default value: 01:00:00 (one hour). Type: string (or Expression with resultType string). |
| type | string: |
The write setting type. |
| useTempFileRename |
|
Upload to temporary file(s) and rename. Disable this option if your SFTP server doesn't support rename operation. Type: boolean (or Expression with resultType boolean). |
SharePointOnlineListSource
A copy activity source for sharePoint online list source.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| httpRequestTimeout |
|
The wait time to get a response from SharePoint Online. Default value is 5 minutes (00:05:00). Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
The OData query to filter the data in SharePoint Online list. For example, "$top=1". Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
ShopifySource
A copy activity Shopify Service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SkipErrorFile
Skip error file.
| Name | Type | Description |
|---|---|---|
| dataInconsistency |
|
Skip if source/sink file changed by other concurrent write. Default is false. Type: boolean (or Expression with resultType boolean). |
| fileMissing |
|
Skip if file is deleted by other client during copy. Default is true. Type: boolean (or Expression with resultType boolean). |
SnowflakeExportCopyCommand
Snowflake export command settings.
| Name | Type | Description |
|---|---|---|
| additionalCopyOptions |
|
Additional copy options directly passed to snowflake Copy Command. Type: key value pairs (value should be string type) (or Expression with resultType object). Example: "additionalCopyOptions": { "DATE_FORMAT": "MM/DD/YYYY", "TIME_FORMAT": "'HH24:MI:SS.FF'" } |
| additionalFormatOptions |
|
Additional format options directly passed to snowflake Copy Command. Type: key value pairs (value should be string type) (or Expression with resultType object). Example: "additionalFormatOptions": { "OVERWRITE": "TRUE", "MAX_FILE_SIZE": "'FALSE'" } |
| storageIntegration |
|
The name of the snowflake storage integration to use for the copy operation. Type: string (or Expression with resultType string). |
| type | string: |
The export setting type. |
SnowflakeImportCopyCommand
Snowflake import command settings.
| Name | Type | Description |
|---|---|---|
| additionalCopyOptions |
|
Additional copy options directly passed to snowflake Copy Command. Type: key value pairs (value should be string type) (or Expression with resultType object). Example: "additionalCopyOptions": { "DATE_FORMAT": "MM/DD/YYYY", "TIME_FORMAT": "'HH24:MI:SS.FF'" } |
| additionalFormatOptions |
|
Additional format options directly passed to snowflake Copy Command. Type: key value pairs (value should be string type) (or Expression with resultType object). Example: "additionalFormatOptions": { "FORCE": "TRUE", "LOAD_UNCERTAIN_FILES": "'FALSE'" } |
| storageIntegration |
|
The name of the snowflake storage integration to use for the copy operation. Type: string (or Expression with resultType string). |
| type | string: |
The import setting type. |
SnowflakeSink
A copy activity snowflake sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| importSettings |
Snowflake import settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
SQL pre-copy script. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
SnowflakeSource
A copy activity snowflake source.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| exportSettings |
Snowflake export settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Snowflake Sql query. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SnowflakeV2Sink
A copy activity snowflake sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| importSettings |
Snowflake import settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
SQL pre-copy script. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
SnowflakeV2Source
A copy activity snowflake source.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| exportSettings |
Snowflake export settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Snowflake Sql query. Type: string (or Expression with resultType string). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SparkConfigurationParametrizationReference
Spark configuration reference.
| Name | Type | Description |
|---|---|---|
| referenceName |
|
Reference spark configuration name. Type: string (or Expression with resultType string). |
| type |
Spark configuration reference type. |
SparkConfigurationReferenceType
Spark configuration reference type.
| Value | Description |
|---|---|
| SparkConfigurationReference |
SparkConfigurationReference |
SparkJobReferenceType
Synapse spark job reference type.
| Value | Description |
|---|---|
| SparkJobDefinitionReference |
SparkJobDefinitionReference |
SparkSource
A copy activity Spark Server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SqlDWSink
A copy activity SQL Data Warehouse sink.
| Name | Type | Description |
|---|---|---|
| allowCopyCommand |
|
Indicates to use Copy Command to copy data into SQL Data Warehouse. Type: boolean (or Expression with resultType boolean). |
| allowPolyBase |
|
Indicates to use PolyBase to copy data into SQL Data Warehouse when applicable. Type: boolean (or Expression with resultType boolean). |
| copyCommandSettings |
Specifies Copy Command related settings when allowCopyCommand is true. |
|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| polyBaseSettings |
Specifies PolyBase-related settings when allowPolyBase is true. |
|
| preCopyScript |
|
SQL pre-copy script. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlWriterUseTableLock |
|
Whether to use table lock during bulk copy. Type: boolean (or Expression with resultType boolean). |
| tableOption |
|
The option to handle sink table, such as autoCreate. For now only 'autoCreate' value is supported. Type: string (or Expression with resultType string). |
| type | string: |
Copy sink type. |
| upsertSettings |
SQL DW upsert settings. |
|
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
Write behavior when copying data into azure SQL DW. Type: SqlDWWriteBehaviorEnum (or Expression with resultType SqlDWWriteBehaviorEnum) |
SqlDWSource
A copy activity SQL Data Warehouse source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| isolationLevel |
|
Specifies the transaction locking behavior for the SQL source. Allowed values: ReadCommitted/ReadUncommitted/RepeatableRead/Serializable/Snapshot. The default value is ReadCommitted. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for Sql read in parallel. Possible values include: "None", "PhysicalPartitionsOfTable", "DynamicRange". Type: string (or Expression with resultType string). |
| partitionSettings |
The settings that will be leveraged for Sql source partitioning. |
|
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlReaderQuery |
|
SQL Data Warehouse reader query. Type: string (or Expression with resultType string). |
| sqlReaderStoredProcedureName |
|
Name of the stored procedure for a SQL Data Warehouse source. This cannot be used at the same time as SqlReaderQuery. Type: string (or Expression with resultType string). |
| storedProcedureParameters |
|
Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}". Type: object (or Expression with resultType object), itemType: StoredProcedureParameter. |
| type | string: |
Copy source type. |
SqlDWUpsertSettings
Sql DW upsert option settings
| Name | Type | Description |
|---|---|---|
| interimSchemaName |
|
Schema name for interim table. Type: string (or Expression with resultType string). |
| keys |
|
Key column names for unique row identification. Type: array of strings (or Expression with resultType array of strings). |
SqlMISink
A copy activity Azure SQL Managed Instance sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
SQL pre-copy script. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlWriterStoredProcedureName |
|
SQL writer stored procedure name. Type: string (or Expression with resultType string). |
| sqlWriterTableType |
|
SQL writer table type. Type: string (or Expression with resultType string). |
| sqlWriterUseTableLock |
|
Whether to use table lock during bulk copy. Type: boolean (or Expression with resultType boolean). |
| storedProcedureParameters |
|
SQL stored procedure parameters. |
| storedProcedureTableTypeParameterName |
|
The stored procedure parameter name of the table type. Type: string (or Expression with resultType string). |
| tableOption |
|
The option to handle sink table, such as autoCreate. For now only 'autoCreate' value is supported. Type: string (or Expression with resultType string). |
| type | string: |
Copy sink type. |
| upsertSettings |
SQL upsert settings. |
|
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
White behavior when copying data into azure SQL MI. Type: string (or Expression with resultType string) |
SqlMISource
A copy activity Azure SQL Managed Instance source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| isolationLevel |
|
Specifies the transaction locking behavior for the SQL source. Allowed values: ReadCommitted/ReadUncommitted/RepeatableRead/Serializable/Snapshot. The default value is ReadCommitted. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for Sql read in parallel. Possible values include: "None", "PhysicalPartitionsOfTable", "DynamicRange". Type: string (or Expression with resultType string). |
| partitionSettings |
The settings that will be leveraged for Sql source partitioning. |
|
| produceAdditionalTypes |
|
Which additional types to produce. |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlReaderQuery |
|
SQL reader query. Type: string (or Expression with resultType string). |
| sqlReaderStoredProcedureName |
|
Name of the stored procedure for a Azure SQL Managed Instance source. This cannot be used at the same time as SqlReaderQuery. Type: string (or Expression with resultType string). |
| storedProcedureParameters |
|
Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}". |
| type | string: |
Copy source type. |
SqlPartitionSettings
The settings that will be leveraged for Sql source partitioning.
| Name | Type | Description |
|---|---|---|
| partitionColumnName |
|
The name of the column in integer or datetime type that will be used for proceeding partitioning. If not specified, the primary key of the table is auto-detected and used as the partition column. Type: string (or Expression with resultType string). |
| partitionLowerBound |
|
The minimum value of the partition column for partition range splitting. This value is used to decide the partition stride, not for filtering the rows in table. All rows in the table or query result will be partitioned and copied. Type: string (or Expression with resultType string). |
| partitionUpperBound |
|
The maximum value of the partition column for partition range splitting. This value is used to decide the partition stride, not for filtering the rows in table. All rows in the table or query result will be partitioned and copied. Type: string (or Expression with resultType string). |
SqlServerSink
A copy activity SQL server sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
SQL pre-copy script. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlWriterStoredProcedureName |
|
SQL writer stored procedure name. Type: string (or Expression with resultType string). |
| sqlWriterTableType |
|
SQL writer table type. Type: string (or Expression with resultType string). |
| sqlWriterUseTableLock |
|
Whether to use table lock during bulk copy. Type: boolean (or Expression with resultType boolean). |
| storedProcedureParameters |
|
SQL stored procedure parameters. |
| storedProcedureTableTypeParameterName |
|
The stored procedure parameter name of the table type. Type: string (or Expression with resultType string). |
| tableOption |
|
The option to handle sink table, such as autoCreate. For now only 'autoCreate' value is supported. Type: string (or Expression with resultType string). |
| type | string: |
Copy sink type. |
| upsertSettings |
SQL upsert settings. |
|
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
Write behavior when copying data into sql server. Type: string (or Expression with resultType string). |
SqlServerSource
A copy activity SQL server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| isolationLevel |
|
Specifies the transaction locking behavior for the SQL source. Allowed values: ReadCommitted/ReadUncommitted/RepeatableRead/Serializable/Snapshot. The default value is ReadCommitted. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for Sql read in parallel. Possible values include: "None", "PhysicalPartitionsOfTable", "DynamicRange". Type: string (or Expression with resultType string). |
| partitionSettings |
The settings that will be leveraged for Sql source partitioning. |
|
| produceAdditionalTypes |
|
Which additional types to produce. |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlReaderQuery |
|
SQL reader query. Type: string (or Expression with resultType string). |
| sqlReaderStoredProcedureName |
|
Name of the stored procedure for a SQL Database source. This cannot be used at the same time as SqlReaderQuery. Type: string (or Expression with resultType string). |
| storedProcedureParameters |
|
Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}". |
| type | string: |
Copy source type. |
SqlServerStoredProcedureActivity
SQL stored procedure activity type.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Sql |
Type of activity. |
| typeProperties.storedProcedureName |
|
Stored procedure name. Type: string (or Expression with resultType string). |
| typeProperties.storedProcedureParameters |
|
Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}". |
| userProperties |
Activity user properties. |
SqlSink
A copy activity SQL sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
SQL pre-copy script. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlWriterStoredProcedureName |
|
SQL writer stored procedure name. Type: string (or Expression with resultType string). |
| sqlWriterTableType |
|
SQL writer table type. Type: string (or Expression with resultType string). |
| sqlWriterUseTableLock |
|
Whether to use table lock during bulk copy. Type: boolean (or Expression with resultType boolean). |
| storedProcedureParameters |
|
SQL stored procedure parameters. |
| storedProcedureTableTypeParameterName |
|
The stored procedure parameter name of the table type. Type: string (or Expression with resultType string). |
| tableOption |
|
The option to handle sink table, such as autoCreate. For now only 'autoCreate' value is supported. Type: string (or Expression with resultType string). |
| type | string: |
Copy sink type. |
| upsertSettings |
SQL upsert settings. |
|
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
Write behavior when copying data into sql. Type: string (or Expression with resultType string). |
SqlSource
A copy activity SQL source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| isolationLevel |
|
Specifies the transaction locking behavior for the SQL source. Allowed values: ReadCommitted/ReadUncommitted/RepeatableRead/Serializable/Snapshot. The default value is ReadCommitted. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for Sql read in parallel. Possible values include: "None", "PhysicalPartitionsOfTable", "DynamicRange". Type: string (or Expression with resultType string). |
| partitionSettings |
The settings that will be leveraged for Sql source partitioning. |
|
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlReaderQuery |
|
SQL reader query. Type: string (or Expression with resultType string). |
| sqlReaderStoredProcedureName |
|
Name of the stored procedure for a SQL Database source. This cannot be used at the same time as SqlReaderQuery. Type: string (or Expression with resultType string). |
| storedProcedureParameters |
|
Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}". |
| type | string: |
Copy source type. |
SqlUpsertSettings
Sql upsert option settings
| Name | Type | Description |
|---|---|---|
| interimSchemaName |
|
Schema name for interim table. Type: string (or Expression with resultType string). |
| keys |
|
Key column names for unique row identification. Type: array of strings (or Expression with resultType array of strings). |
| useTempDB |
|
Specifies whether to use temp db for upsert interim table. Type: boolean (or Expression with resultType boolean). |
SquareSource
A copy activity Square Service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SSISAccessCredential
SSIS access credential.
| Name | Type | Description |
|---|---|---|
| domain |
|
Domain for windows authentication. Type: string (or Expression with resultType string). |
| password | SecretBase: |
Password for windows authentication. |
| userName |
|
UseName for windows authentication. Type: string (or Expression with resultType string). |
SSISChildPackage
SSIS embedded child package.
| Name | Type | Description |
|---|---|---|
| packageContent |
|
Content for embedded child package. Type: string (or Expression with resultType string). |
| packageLastModifiedDate |
string |
Last modified date for embedded child package. |
| packageName |
string |
Name for embedded child package. |
| packagePath |
|
Path for embedded child package. Type: string (or Expression with resultType string). |
SSISExecutionCredential
SSIS package execution credential.
| Name | Type | Description |
|---|---|---|
| domain |
|
Domain for windows authentication. Type: string (or Expression with resultType string). |
| password |
Password for windows authentication. |
|
| userName |
|
UseName for windows authentication. Type: string (or Expression with resultType string). |
SSISExecutionParameter
SSIS execution parameter.
| Name | Type | Description |
|---|---|---|
| value |
|
SSIS package execution parameter value. Type: string (or Expression with resultType string). |
SSISLogLocation
SSIS package execution log location
| Name | Type | Description |
|---|---|---|
| logPath |
|
The SSIS package execution log path. Type: string (or Expression with resultType string). |
| type |
The type of SSIS log location. |
|
| typeProperties.accessCredential |
The package execution log access credential. |
|
| typeProperties.logRefreshInterval |
|
Specifies the interval to refresh log. The default interval is 5 minutes. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
SsisLogLocationType
The type of SSIS log location.
| Value | Description |
|---|---|
| File |
File |
SSISPackageLocation
SSIS package location.
| Name | Type | Description |
|---|---|---|
| packagePath |
|
The SSIS package path. Type: string (or Expression with resultType string). |
| type |
The type of SSIS package location. |
|
| typeProperties.accessCredential |
The package access credential. |
|
| typeProperties.childPackages |
The embedded child package list. |
|
| typeProperties.configurationAccessCredential |
The configuration file access credential. |
|
| typeProperties.configurationPath |
|
The configuration file of the package execution. Type: string (or Expression with resultType string). |
| typeProperties.packageContent |
|
The embedded package content. Type: string (or Expression with resultType string). |
| typeProperties.packageLastModifiedDate |
string |
The embedded package last modified date. |
| typeProperties.packageName |
string |
The package name. |
| typeProperties.packagePassword | SecretBase: |
Password of the package. |
SsisPackageLocationType
The type of SSIS package location.
| Value | Description |
|---|---|
| SSISDB |
SSISDB |
| File |
File |
| InlinePackage |
InlinePackage |
| PackageStore |
PackageStore |
SSISPropertyOverride
SSIS property override.
| Name | Type | Description |
|---|---|---|
| isSensitive |
boolean |
Whether SSIS package property override value is sensitive data. Value will be encrypted in SSISDB if it is true |
| value |
|
SSIS package property override value. Type: string (or Expression with resultType string). |
StagingSettings
Staging settings.
| Name | Type | Description |
|---|---|---|
| enableCompression |
|
Specifies whether to use compression when copying data via an interim staging. Default value is false. Type: boolean (or Expression with resultType boolean). |
| linkedServiceName |
Staging linked service reference. |
|
| path |
|
The path to storage for storing the interim data. Type: string (or Expression with resultType string). |
SwitchActivity
This activity evaluates an expression and executes activities under the cases property that correspond to the expression evaluation expected in the equals property.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Switch |
Type of activity. |
| typeProperties.cases |
List of cases that correspond to expected values of the 'on' property. This is an optional property and if not provided, the activity will execute activities provided in defaultActivities. |
|
| typeProperties.defaultActivities |
Activity[]:
|
List of activities to execute if no case condition is satisfied. This is an optional property and if not provided, the activity will exit without any action. |
| typeProperties.on |
An expression that would evaluate to a string or integer. This is used to determine the block of activities in cases that will be executed. |
|
| userProperties |
Activity user properties. |
SwitchCase
Switch cases with have a value and corresponding activities.
SybaseSource
A copy activity source for Sybase databases.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
Database query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
SynapseNotebookActivity
Execute Synapse notebook activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Synapse |
Type of activity. |
| typeProperties.conf |
|
Spark configuration properties, which will override the 'conf' of the notebook you provide. |
| typeProperties.configurationType |
The type of the spark config. |
|
| typeProperties.driverSize |
|
Number of core and memory to be used for driver allocated in the specified Spark pool for the session, which will be used for overriding 'driverCores' and 'driverMemory' of the notebook you provide. Type: string (or Expression with resultType string). |
| typeProperties.executorSize |
|
Number of core and memory to be used for executors allocated in the specified Spark pool for the session, which will be used for overriding 'executorCores' and 'executorMemory' of the notebook you provide. Type: string (or Expression with resultType string). |
| typeProperties.notebook |
Synapse notebook reference. |
|
| typeProperties.numExecutors |
|
Number of executors to launch for this session, which will override the 'numExecutors' of the notebook you provide. Type: integer (or Expression with resultType integer). |
| typeProperties.parameters |
<string,
Notebook |
Notebook parameters. |
| typeProperties.sparkConfig |
|
Spark configuration property. |
| typeProperties.sparkPool |
The name of the big data pool which will be used to execute the notebook. |
|
| typeProperties.targetSparkConfiguration |
The spark configuration of the spark job. |
|
| userProperties |
Activity user properties. |
SynapseNotebookReference
Synapse notebook reference type.
| Name | Type | Description |
|---|---|---|
| referenceName |
|
Reference notebook name. Type: string (or Expression with resultType string). |
| type |
Synapse notebook reference type. |
SynapseSparkJobDefinitionActivity
Execute spark job activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Spark |
Type of activity. |
| typeProperties.args |
Synapse |
User specified arguments to SynapseSparkJobDefinitionActivity. |
| typeProperties.className |
|
The fully-qualified identifier or the main class that is in the main definition file, which will override the 'className' of the spark job definition you provide. Type: string (or Expression with resultType string). |
| typeProperties.conf |
|
Spark configuration properties, which will override the 'conf' of the spark job definition you provide. |
| typeProperties.configurationType |
The type of the spark config. |
|
| typeProperties.driverSize |
|
Number of core and memory to be used for driver allocated in the specified Spark pool for the job, which will be used for overriding 'driverCores' and 'driverMemory' of the spark job definition you provide. Type: string (or Expression with resultType string). |
| typeProperties.executorSize |
|
Number of core and memory to be used for executors allocated in the specified Spark pool for the job, which will be used for overriding 'executorCores' and 'executorMemory' of the spark job definition you provide. Type: string (or Expression with resultType string). |
| typeProperties.file |
|
The main file used for the job, which will override the 'file' of the spark job definition you provide. Type: string (or Expression with resultType string). |
| typeProperties.files |
Synapse |
(Deprecated. Please use pythonCodeReference and filesV2) Additional files used for reference in the main definition file, which will override the 'files' of the spark job definition you provide. |
| typeProperties.filesV2 |
Synapse |
Additional files used for reference in the main definition file, which will override the 'jars' and 'files' of the spark job definition you provide. |
| typeProperties.numExecutors |
|
Number of executors to launch for this job, which will override the 'numExecutors' of the spark job definition you provide. Type: integer (or Expression with resultType integer). |
| typeProperties.pythonCodeReference |
Synapse |
Additional python code files used for reference in the main definition file, which will override the 'pyFiles' of the spark job definition you provide. |
| typeProperties.scanFolder |
|
Scanning subfolders from the root folder of the main definition file, these files will be added as reference files. The folders named 'jars', 'pyFiles', 'files' or 'archives' will be scanned, and the folders name are case sensitive. Type: boolean (or Expression with resultType boolean). |
| typeProperties.sparkConfig |
|
Spark configuration property. |
| typeProperties.sparkJob |
Synapse spark job reference. |
|
| typeProperties.targetBigDataPool |
The name of the big data pool which will be used to execute the spark batch job, which will override the 'targetBigDataPool' of the spark job definition you provide. |
|
| typeProperties.targetSparkConfiguration |
The spark configuration of the spark job. |
|
| userProperties |
Activity user properties. |
SynapseSparkJobReference
Synapse spark job reference type.
| Name | Type | Description |
|---|---|---|
| referenceName |
|
Reference spark job name. Expression with resultType string. |
| type |
Synapse spark job reference type. |
systemData
Metadata pertaining to creation and last modification of the resource.
| Name | Type | Description |
|---|---|---|
| createdAt |
string (date-time) |
The timestamp of resource creation (UTC). |
| createdBy |
string |
The identity that created the resource. |
| createdByType |
The type of identity that created the resource. |
|
| lastModifiedAt |
string (date-time) |
The timestamp of resource last modification (UTC) |
| lastModifiedBy |
string |
The identity that last modified the resource. |
| lastModifiedByType |
The type of identity that last modified the resource. |
TabularSource
Copy activity sources of tabular type.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
TarGZipReadSettings
The TarGZip compression read settings.
| Name | Type | Description |
|---|---|---|
| preserveCompressionFileNameAsFolder |
|
Preserve the compression file name as folder path. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The Compression setting type. |
TarReadSettings
The Tar compression read settings.
| Name | Type | Description |
|---|---|---|
| preserveCompressionFileNameAsFolder |
|
Preserve the compression file name as folder path. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The Compression setting type. |
TeradataImportCommand
Teradata import command settings.
| Name | Type | Description |
|---|---|---|
| additionalFormatOptions |
|
Additional format options for Teradata Copy Command. The format options only applies to direct copy from CSV source. Type: key value pairs (value should be string type) (or Expression with resultType object). Example: "additionalFormatOptions": { "timeFormat": "HHhMImSSs" } |
| type | string: |
The import setting type. |
TeradataPartitionSettings
The settings that will be leveraged for teradata source partitioning.
| Name | Type | Description |
|---|---|---|
| partitionColumnName |
|
The name of the column that will be used for proceeding range or hash partitioning. Type: string (or Expression with resultType string). |
| partitionLowerBound |
|
The minimum value of column specified in partitionColumnName that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
| partitionUpperBound |
|
The maximum value of column specified in partitionColumnName that will be used for proceeding range partitioning. Type: string (or Expression with resultType string). |
TeradataSink
A copy activity Teradata sink.
| Name | Type | Description |
|---|---|---|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| importSettings |
Teradata import settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
TeradataSource
A copy activity Teradata source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for teradata read in parallel. Possible values include: "None", "Hash", "DynamicRange". |
| partitionSettings |
The settings that will be leveraged for teradata source partitioning. |
|
| query |
|
Teradata query. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
Type
Linked service reference type.
| Value | Description |
|---|---|
| LinkedServiceReference |
LinkedServiceReference |
UntilActivity
This activity executes inner activities until the specified boolean expression results to true or timeout is reached, whichever is earlier.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Until |
Type of activity. |
| typeProperties.activities |
Activity[]:
|
List of activities to execute. |
| typeProperties.expression |
An expression that would evaluate to Boolean. The loop will continue until this expression evaluates to true |
|
| typeProperties.timeout |
|
Specifies the timeout for the activity to run. If there is no value specified, it takes the value of TimeSpan.FromDays(7) which is 1 week as default. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| userProperties |
Activity user properties. |
UserProperty
User property.
| Name | Type | Description |
|---|---|---|
| name |
string |
User property name. |
| value |
|
User property value. Type: string (or Expression with resultType string). |
ValidationActivity
This activity verifies that an external resource exists.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Validation |
Type of activity. |
| typeProperties.childItems |
|
Can be used if dataset points to a folder. If set to true, the folder must have at least one file. If set to false, the folder must be empty. Type: boolean (or Expression with resultType boolean). |
| typeProperties.dataset |
Validation activity dataset reference. |
|
| typeProperties.minimumSize |
|
Can be used if dataset points to a file. The file must be greater than or equal in size to the value specified. Type: integer (or Expression with resultType integer). |
| typeProperties.sleep |
|
A delay in seconds between validation attempts. If no value is specified, 10 seconds will be used as the default. Type: integer (or Expression with resultType integer). |
| typeProperties.timeout |
|
Specifies the timeout for the activity to run. If there is no value specified, it takes the value of TimeSpan.FromDays(7) which is 1 week as default. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| userProperties |
Activity user properties. |
VariableSpecification
Definition of a single variable for a Pipeline.
| Name | Type | Description |
|---|---|---|
| defaultValue |
|
Default value of variable. |
| type |
Variable type. |
VariableType
Variable type.
| Value | Description |
|---|---|
| String |
String |
| Bool |
Bool |
| Array |
Array |
VerticaSource
A copy activity Vertica source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
WaitActivity
This activity suspends pipeline execution for the specified interval.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Wait |
Type of activity. |
| typeProperties.waitTimeInSeconds |
|
Duration in seconds. Type: integer (or Expression with resultType integer). |
| userProperties |
Activity user properties. |
WarehouseSink
A copy activity Microsoft Fabric Warehouse sink.
| Name | Type | Description |
|---|---|---|
| allowCopyCommand |
|
Indicates to use Copy Command to copy data into SQL Data Warehouse. Type: boolean (or Expression with resultType boolean). |
| copyCommandSettings |
Specifies Copy Command related settings when allowCopyCommand is true. |
|
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the sink data store. Type: integer (or Expression with resultType integer). |
| preCopyScript |
|
SQL pre-copy script. Type: string (or Expression with resultType string). |
| sinkRetryCount |
|
Sink retry count. Type: integer (or Expression with resultType integer). |
| sinkRetryWait |
|
Sink retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| tableOption |
|
The option to handle sink table, such as autoCreate. For now only 'autoCreate' value is supported. Type: string (or Expression with resultType string). |
| type | string: |
Copy sink type. |
| writeBatchSize |
|
Write batch size. Type: integer (or Expression with resultType integer), minimum: 0. |
| writeBatchTimeout |
|
Write batch timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| writeBehavior |
|
Write behavior when copying data into azure Microsoft Fabric Data Warehouse. Type: DWWriteBehaviorEnum (or Expression with resultType DWWriteBehaviorEnum) |
WarehouseSource
A copy activity Microsoft Fabric Warehouse source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| isolationLevel |
|
Specifies the transaction locking behavior for the Microsoft Fabric Warehouse source. Allowed values: ReadCommitted/ReadUncommitted/RepeatableRead/Serializable/Snapshot. The default value is ReadCommitted. Type: string (or Expression with resultType string). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| partitionOption |
|
The partition mechanism that will be used for Sql read in parallel. Possible values include: "None", "PhysicalPartitionsOfTable", "DynamicRange". |
| partitionSettings |
The settings that will be leveraged for Sql source partitioning. |
|
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sqlReaderQuery |
|
Microsoft Fabric Warehouse reader query. Type: string (or Expression with resultType string). |
| sqlReaderStoredProcedureName |
|
Name of the stored procedure for a Microsoft Fabric Warehouse source. This cannot be used at the same time as SqlReaderQuery. Type: string (or Expression with resultType string). |
| storedProcedureParameters |
|
Value and type setting for stored procedure parameters. Example: "{Parameter1: {value: "1", type: "int"}}". Type: object (or Expression with resultType object), itemType: StoredProcedureParameter. |
| type | string: |
Copy source type. |
WebActivity
Web activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| linkedServiceName |
Linked service reference. |
|
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type | string: |
Type of activity. |
| typeProperties.authentication |
Authentication method used for calling the endpoint. |
|
| typeProperties.body |
|
Represents the payload that will be sent to the endpoint. Required for POST/PUT method, not allowed for GET method Type: string (or Expression with resultType string). |
| typeProperties.connectVia |
The integration runtime reference. |
|
| typeProperties.datasets |
List of datasets passed to web endpoint. |
|
| typeProperties.disableCertValidation |
boolean |
When set to true, Certificate validation will be disabled. |
| typeProperties.headers |
|
Represents the headers that will be sent to the request. For example, to set the language and type on a request: "headers" : { "Accept-Language": "en-us", "Content-Type": "application/json" }. Type: string (or Expression with resultType string). |
| typeProperties.httpRequestTimeout |
|
Timeout for the HTTP request to get a response. Format is in TimeSpan (hh:mm:ss). This value is the timeout to get a response, not the activity timeout. The default value is 00:01:00 (1 minute). The range is from 1 to 10 minutes |
| typeProperties.linkedServices |
List of linked services passed to web endpoint. |
|
| typeProperties.method |
Rest API method for target endpoint. |
|
| typeProperties.turnOffAsync |
boolean |
Option to disable invoking HTTP GET on location given in response header of a HTTP 202 Response. If set true, it stops invoking HTTP GET on http location given in response header. If set false then continues to invoke HTTP GET call on location given in http response headers. |
| typeProperties.url |
|
Web activity target endpoint and path. Type: string (or Expression with resultType string). |
| userProperties |
Activity user properties. |
WebActivityAuthentication
Web activity authentication properties.
| Name | Type | Description |
|---|---|---|
| credential |
The credential reference containing authentication information. |
|
| password | SecretBase: |
Password for the PFX file or basic authentication / Secret when used for ServicePrincipal |
| pfx | SecretBase: |
Base64-encoded contents of a PFX file or Certificate when used for ServicePrincipal |
| resource |
|
Resource for which Azure Auth token will be requested when using MSI Authentication. Type: string (or Expression with resultType string). |
| type |
string |
Web activity authentication (Basic/ClientCertificate/MSI/ServicePrincipal) |
| userTenant |
|
TenantId for which Azure Auth token will be requested when using ServicePrincipal Authentication. Type: string (or Expression with resultType string). |
| username |
|
Web activity authentication user name for basic authentication or ClientID when used for ServicePrincipal. Type: string (or Expression with resultType string). |
WebActivityMethod
The list of HTTP methods supported by a WebActivity.
| Value | Description |
|---|---|
| GET |
GET |
| POST |
POST |
| PUT |
PUT |
| DELETE |
DELETE |
WebHookActivity
WebHook activity.
| Name | Type | Description |
|---|---|---|
| dependsOn |
Activity depends on condition. |
|
| description |
string |
Activity description. |
| name |
string |
Activity name. |
| onInactiveMarkAs |
Status result of the activity when the state is set to Inactive. This is an optional property and if not provided when the activity is inactive, the status will be Succeeded by default. |
|
| policy |
Activity policy. |
|
| state |
Activity state. This is an optional property and if not provided, the state will be Active by default. |
|
| type |
string:
Web |
Type of activity. |
| typeProperties.authentication |
Authentication method used for calling the endpoint. |
|
| typeProperties.body |
|
Represents the payload that will be sent to the endpoint. Required for POST/PUT method, not allowed for GET method Type: string (or Expression with resultType string). |
| typeProperties.headers |
|
Represents the headers that will be sent to the request. For example, to set the language and type on a request: "headers" : { "Accept-Language": "en-us", "Content-Type": "application/json" }. Type: string (or Expression with resultType string). |
| typeProperties.method |
Rest API method for target endpoint. |
|
| typeProperties.reportStatusOnCallBack |
|
When set to true, statusCode, output and error in callback request body will be consumed by activity. The activity can be marked as failed by setting statusCode >= 400 in callback request. Default is false. Type: boolean (or Expression with resultType boolean). |
| typeProperties.timeout |
string |
The timeout within which the webhook should be called back. If there is no value specified, it defaults to 10 minutes. Type: string. Pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| typeProperties.url |
|
WebHook activity target endpoint and path. Type: string (or Expression with resultType string). |
| userProperties |
Activity user properties. |
WebHookActivityMethod
The list of HTTP methods supported by a WebHook activity.
| Value | Description |
|---|---|
| POST |
POST |
WebSource
A copy activity source for web page table.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
XeroSource
A copy activity Xero Service source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |
XmlReadSettings
Xml read settings.
| Name | Type | Description |
|---|---|---|
| compressionProperties | CompressionReadSettings: |
Compression settings. |
| detectDataType |
|
Indicates whether type detection is enabled when reading the xml files. Type: boolean (or Expression with resultType boolean). |
| namespacePrefixes |
|
Namespace uri to prefix mappings to override the prefixes in column names when namespace is enabled, if no prefix is defined for a namespace uri, the prefix of xml element/attribute name in the xml data file will be used. Example: "{"http://www.example.com/xml":"prefix"}" Type: object (or Expression with resultType object). |
| namespaces |
|
Indicates whether namespace is enabled when reading the xml files. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The read setting type. |
| validationMode |
|
Indicates what validation method is used when reading the xml files. Allowed values: 'none', 'xsd', or 'dtd'. Type: string (or Expression with resultType string). |
XmlSource
A copy activity Xml source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| formatSettings |
Xml format settings. |
|
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| storeSettings |
StoreReadSettings:
|
Xml store settings. |
| type | string: |
Copy source type. |
ZipDeflateReadSettings
The ZipDeflate compression read settings.
| Name | Type | Description |
|---|---|---|
| preserveZipFileNameAsFolder |
|
Preserve the zip file name as folder path. Type: boolean (or Expression with resultType boolean). |
| type | string: |
The Compression setting type. |
ZohoSource
A copy activity Zoho server source.
| Name | Type | Description |
|---|---|---|
| additionalColumns |
|
Specifies the additional columns to be added to source data. Type: array of objects(AdditionalColumns) (or Expression with resultType array of objects). |
| disableMetricsCollection |
|
If true, disable data store metrics collection. Default is false. Type: boolean (or Expression with resultType boolean). |
| maxConcurrentConnections |
|
The maximum concurrent connection count for the source data store. Type: integer (or Expression with resultType integer). |
| query |
|
A query to retrieve data from source. Type: string (or Expression with resultType string). |
| queryTimeout |
|
Query timeout. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| sourceRetryCount |
|
Source retry count. Type: integer (or Expression with resultType integer). |
| sourceRetryWait |
|
Source retry wait. Type: string (or Expression with resultType string), pattern: ((\d+).)?(\d\d):(60|([0-5][0-9])):(60|([0-5][0-9])). |
| type | string: |
Copy source type. |