Datasets - Create Or Update

Service:

Data Factory

API Version:

2018-06-01

Creates or updates a dataset.

PUT https://management.azure.com/subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/Microsoft.DataFactory/factories/{factoryName}/datasets/{datasetName}?api-version=2018-06-01

URI Parameters

Name	In	Required	Type	Description
datasetName	path	True	string	The dataset name. Regex pattern: ^[A-Za-z0-9_][^<>*#.%&:\\+?/]*$
factoryName	path	True	string	The factory name. Regex pattern: ^[A-Za-z0-9]+(?:-[A-Za-z0-9]+)*$
resourceGroupName	path	True	string	The resource group name. Regex pattern: ^[-\w\._\(\)]+$
subscriptionId	path	True	string	The subscription identifier.
api-version	query	True	string	The API version.

Request Header

Name	Required	Type	Description
If-Match		string	ETag of the dataset entity. Should only be specified for update, for which it should match existing entity or can be * for unconditional update.

Request Body

Name	Required	Type	Description
properties	True	Dataset: AmazonS3Dataset AvroDataset ExcelDataset ParquetDataset DelimitedTextDataset JsonDataset XmlDataset OrcDataset BinaryDataset AzureBlobDataset AzureTableDataset AzureSqlTableDataset AzureSqlMITableDataset AzureSqlDWTableDataset CassandraTableDataset CosmosDbSqlApiCollectionDataset DocumentDbCollectionDataset DynamicsEntityDataset DynamicsCrmEntityDataset CommonDataServiceForAppsEntityDataset AzureDataLakeStoreDataset AzureBlobFSDataset Office365Dataset FileShareDataset MongoDbCollectionDataset MongoDbAtlasCollectionDataset MongoDbV2CollectionDataset CosmosDbMongoDbApiCollectionDataset ODataResourceDataset OracleTableDataset AmazonRdsForOracleTableDataset TeradataTableDataset AzureMySqlTableDataset AmazonRedshiftTableDataset Db2TableDataset RelationalTableDataset InformixTableDataset OdbcTableDataset MySqlTableDataset PostgreSqlTableDataset PostgreSqlV2TableDataset MicrosoftAccessTableDataset SalesforceObjectDataset SalesforceServiceCloudObjectDataset SybaseTableDataset SapBwCubeDataset SapCloudForCustomerResourceDataset SapEccResourceDataset SapHanaTableDataset SapOpenHubTableDataset SqlServerTableDataset AmazonRdsForSqlServerTableDataset RestResourceDataset SapTableResourceDataset SapOdpResourceDataset WebTableDataset AzureSearchIndexDataset HttpDataset AmazonMWSObjectDataset AzurePostgreSqlTableDataset ConcurObjectDataset CouchbaseTableDataset DrillTableDataset EloquaObjectDataset GoogleBigQueryObjectDataset GoogleBigQueryV2ObjectDataset GreenplumTableDataset HBaseObjectDataset HiveObjectDataset HubspotObjectDataset ImpalaObjectDataset JiraObjectDataset MagentoObjectDataset MariaDBTableDataset AzureMariaDBTableDataset MarketoObjectDataset PaypalObjectDataset PhoenixObjectDataset PrestoObjectDataset QuickBooksObjectDataset ServiceNowObjectDataset ShopifyObjectDataset SparkObjectDataset SquareObjectDataset XeroObjectDataset ZohoObjectDataset NetezzaTableDataset VerticaTableDataset SalesforceMarketingCloudObjectDataset ResponsysObjectDataset DynamicsAXResourceDataset OracleServiceCloudObjectDataset AzureDataExplorerTableDataset GoogleAdWordsObjectDataset SnowflakeDataset SnowflakeV2Dataset SharePointOnlineListResourceDataset AzureDatabricksDeltaLakeDataset LakeHouseTableDataset SalesforceV2ObjectDataset SalesforceServiceCloudV2ObjectDataset WarehouseTableDataset ServiceNowV2ObjectDataset	Dataset properties.

Responses

Name	Type	Description
200 OK	DatasetResource	OK.
Other Status Codes	CloudError	An error response received from the Azure Data Factory service.

Security

azure_auth

Azure Active Directory OAuth2 Flow.

Type: oauth2
Flow: implicit
Authorization URL: https://login.microsoftonline.com/common/oauth2/authorize

Scopes

Name	Description
user_impersonation	impersonate your user account

Examples

Datasets_Create

Datasets_Update

Datasets_Create

Sample Request

HTTP

PUT https://management.azure.com/subscriptions/12345678-1234-1234-1234-12345678abc/resourceGroups/exampleResourceGroup/providers/Microsoft.DataFactory/factories/exampleFactoryName/datasets/exampleDataset?api-version=2018-06-01

{
  "properties": {
    "type": "AzureBlob",
    "typeProperties": {
      "folderPath": {
        "value": "@dataset().MyFolderPath",
        "type": "Expression"
      },
      "fileName": {
        "value": "@dataset().MyFileName",
        "type": "Expression"
      },
      "format": {
        "type": "TextFormat"
      }
    },
    "linkedServiceName": {
      "referenceName": "exampleLinkedService",
      "type": "LinkedServiceReference"
    },
    "parameters": {
      "MyFolderPath": {
        "type": "String"
      },
      "MyFileName": {
        "type": "String"
      }
    }
  }
}

Java

import com.azure.core.management.serializer.SerializerFactory;
import com.azure.core.util.serializer.SerializerEncoding;
import com.azure.resourcemanager.datafactory.models.AzureBlobDataset;
import com.azure.resourcemanager.datafactory.models.LinkedServiceReference;
import com.azure.resourcemanager.datafactory.models.ParameterSpecification;
import com.azure.resourcemanager.datafactory.models.ParameterType;
import com.azure.resourcemanager.datafactory.models.TextFormat;
import java.io.IOException;
import java.util.HashMap;
import java.util.Map;

/**
 * Samples for Datasets CreateOrUpdate.
 */
public final class Main {
    /*
     * x-ms-original-file:
     * specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/examples/Datasets_Create.json
     */
    /**
     * Sample code: Datasets_Create.
     * 
     * @param manager Entry point to DataFactoryManager.
     */
    public static void datasetsCreate(com.azure.resourcemanager.datafactory.DataFactoryManager manager)
        throws IOException {
        manager.datasets().define("exampleDataset").withExistingFactory("exampleResourceGroup", "exampleFactoryName")
            .withProperties(new AzureBlobDataset()
                .withLinkedServiceName(new LinkedServiceReference().withReferenceName("exampleLinkedService"))
                .withParameters(mapOf("MyFileName", new ParameterSpecification().withType(ParameterType.STRING),
                    "MyFolderPath", new ParameterSpecification().withType(ParameterType.STRING)))
                .withFolderPath(SerializerFactory.createDefaultManagementSerializerAdapter().deserialize(
                    "{\"type\":\"Expression\",\"value\":\"@dataset().MyFolderPath\"}", Object.class,
                    SerializerEncoding.JSON))
                .withFileName(SerializerFactory.createDefaultManagementSerializerAdapter().deserialize(
                    "{\"type\":\"Expression\",\"value\":\"@dataset().MyFileName\"}", Object.class,
                    SerializerEncoding.JSON))
                .withFormat(new TextFormat()))
            .create();
    }

    // Use "Map.of" if available
    @SuppressWarnings("unchecked")
    private static <T> Map<String, T> mapOf(Object... inputs) {
        Map<String, T> map = new HashMap<>();
        for (int i = 0; i < inputs.length; i += 2) {
            String key = (String) inputs[i];
            T value = (T) inputs[i + 1];
            map.put(key, value);
        }
        return map;
    }
}

To use the Azure SDK library in your project, see this documentation. To provide feedback on this code sample, open a GitHub issue

Python

from azure.identity import DefaultAzureCredential
from azure.mgmt.datafactory import DataFactoryManagementClient

"""
# PREREQUISITES
    pip install azure-identity
    pip install azure-mgmt-datafactory
# USAGE
    python datasets_create.py

    Before run the sample, please set the values of the client ID, tenant ID and client secret
    of the AAD application as environment variables: AZURE_CLIENT_ID, AZURE_TENANT_ID,
    AZURE_CLIENT_SECRET. For more info about how to get the value, please see:
    https://docs.microsoft.com/azure/active-directory/develop/howto-create-service-principal-portal
"""


def main():
    client = DataFactoryManagementClient(
        credential=DefaultAzureCredential(),
        subscription_id="12345678-1234-1234-1234-12345678abc",
    )

    response = client.datasets.create_or_update(
        resource_group_name="exampleResourceGroup",
        factory_name="exampleFactoryName",
        dataset_name="exampleDataset",
        dataset={
            "properties": {
                "linkedServiceName": {"referenceName": "exampleLinkedService", "type": "LinkedServiceReference"},
                "parameters": {"MyFileName": {"type": "String"}, "MyFolderPath": {"type": "String"}},
                "type": "AzureBlob",
                "typeProperties": {
                    "fileName": {"type": "Expression", "value": "@dataset().MyFileName"},
                    "folderPath": {"type": "Expression", "value": "@dataset().MyFolderPath"},
                    "format": {"type": "TextFormat"},
                },
            }
        },
    )
    print(response)


# x-ms-original-file: specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/examples/Datasets_Create.json
if __name__ == "__main__":
    main()

To use the Azure SDK library in your project, see this documentation. To provide feedback on this code sample, open a GitHub issue

Go

package armdatafactory_test

import (
	"context"
	"log"

	"github.com/Azure/azure-sdk-for-go/sdk/azcore/to"
	"github.com/Azure/azure-sdk-for-go/sdk/azidentity"
	"github.com/Azure/azure-sdk-for-go/sdk/resourcemanager/datafactory/armdatafactory/v6"
)

// Generated from example definition: https://github.com/Azure/azure-rest-api-specs/blob/01a71545e82bb98b8137d3038150c436d46a59ed/specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/examples/Datasets_Create.json
func ExampleDatasetsClient_CreateOrUpdate_datasetsCreate() {
	cred, err := azidentity.NewDefaultAzureCredential(nil)
	if err != nil {
		log.Fatalf("failed to obtain a credential: %v", err)
	}
	ctx := context.Background()
	clientFactory, err := armdatafactory.NewClientFactory("<subscription-id>", cred, nil)
	if err != nil {
		log.Fatalf("failed to create client: %v", err)
	}
	res, err := clientFactory.NewDatasetsClient().CreateOrUpdate(ctx, "exampleResourceGroup", "exampleFactoryName", "exampleDataset", armdatafactory.DatasetResource{
		Properties: &armdatafactory.AzureBlobDataset{
			Type: to.Ptr("AzureBlob"),
			LinkedServiceName: &armdatafactory.LinkedServiceReference{
				Type:          to.Ptr(armdatafactory.LinkedServiceReferenceTypeLinkedServiceReference),
				ReferenceName: to.Ptr("exampleLinkedService"),
			},
			Parameters: map[string]*armdatafactory.ParameterSpecification{
				"MyFileName": {
					Type: to.Ptr(armdatafactory.ParameterTypeString),
				},
				"MyFolderPath": {
					Type: to.Ptr(armdatafactory.ParameterTypeString),
				},
			},
			TypeProperties: &armdatafactory.AzureBlobDatasetTypeProperties{
				Format: &armdatafactory.TextFormat{
					Type: to.Ptr("TextFormat"),
				},
				FileName: map[string]any{
					"type":  "Expression",
					"value": "@dataset().MyFileName",
				},
				FolderPath: map[string]any{
					"type":  "Expression",
					"value": "@dataset().MyFolderPath",
				},
			},
		},
	}, &armdatafactory.DatasetsClientCreateOrUpdateOptions{IfMatch: nil})
	if err != nil {
		log.Fatalf("failed to finish the request: %v", err)
	}
	// You could use response here. We use blank identifier for just demo purposes.
	_ = res
	// If the HTTP response code is 200 as defined in example definition, your response structure would look as follows. Please pay attention that all the values in the output are fake values for just demo purposes.
	// res.DatasetResource = armdatafactory.DatasetResource{
	// 	Name: to.Ptr("exampleDataset"),
	// 	Type: to.Ptr("Microsoft.DataFactory/factories/datasets"),
	// 	Etag: to.Ptr("0a0066d4-0000-0000-0000-5b245bd20000"),
	// 	ID: to.Ptr("/subscriptions/12345678-1234-1234-1234-12345678abc/resourceGroups/exampleResourceGroup/providers/Microsoft.DataFactory/factories/exampleFactoryName/datasets/exampleDataset"),
	// 	Properties: &armdatafactory.AzureBlobDataset{
	// 		Type: to.Ptr("AzureBlob"),
	// 		Schema: []any{
	// 			map[string]any{
	// 				"name": "col1",
	// 				"type": "INT_32",
	// 			},
	// 			map[string]any{
	// 				"name": "col2",
	// 				"type": "Decimal",
	// 				"precision": "38",
	// 				"scale": "2",
	// 			},
	// 		},
	// 		LinkedServiceName: &armdatafactory.LinkedServiceReference{
	// 			Type: to.Ptr(armdatafactory.LinkedServiceReferenceTypeLinkedServiceReference),
	// 			ReferenceName: to.Ptr("exampleLinkedService"),
	// 		},
	// 		Parameters: map[string]*armdatafactory.ParameterSpecification{
	// 			"MyFileName": &armdatafactory.ParameterSpecification{
	// 				Type: to.Ptr(armdatafactory.ParameterTypeString),
	// 			},
	// 			"MyFolderPath": &armdatafactory.ParameterSpecification{
	// 				Type: to.Ptr(armdatafactory.ParameterTypeString),
	// 			},
	// 		},
	// 		TypeProperties: &armdatafactory.AzureBlobDatasetTypeProperties{
	// 			Format: &armdatafactory.TextFormat{
	// 				Type: to.Ptr("TextFormat"),
	// 			},
	// 			FileName: map[string]any{
	// 				"type": "Expression",
	// 				"value": "@dataset().MyFileName",
	// 			},
	// 			FolderPath: map[string]any{
	// 				"type": "Expression",
	// 				"value": "@dataset().MyFolderPath",
	// 			},
	// 		},
	// 	},
	// }
}

To use the Azure SDK library in your project, see this documentation. To provide feedback on this code sample, open a GitHub issue

JavaScript

const { DataFactoryManagementClient } = require("@azure/arm-datafactory");
const { DefaultAzureCredential } = require("@azure/identity");

/**
 * This sample demonstrates how to Creates or updates a dataset.
 *
 * @summary Creates or updates a dataset.
 * x-ms-original-file: specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/examples/Datasets_Create.json
 */
async function datasetsCreate() {
  const subscriptionId =
    process.env["DATAFACTORY_SUBSCRIPTION_ID"] || "12345678-1234-1234-1234-12345678abc";
  const resourceGroupName = process.env["DATAFACTORY_RESOURCE_GROUP"] || "exampleResourceGroup";
  const factoryName = "exampleFactoryName";
  const datasetName = "exampleDataset";
  const dataset = {
    properties: {
      type: "AzureBlob",
      format: { type: "TextFormat" },
      fileName: { type: "Expression", value: "@dataset().MyFileName" },
      folderPath: { type: "Expression", value: "@dataset().MyFolderPath" },
      linkedServiceName: {
        type: "LinkedServiceReference",
        referenceName: "exampleLinkedService",
      },
      parameters: {
        myFileName: { type: "String" },
        myFolderPath: { type: "String" },
      },
    },
  };
  const credential = new DefaultAzureCredential();
  const client = new DataFactoryManagementClient(credential, subscriptionId);
  const result = await client.datasets.createOrUpdate(
    resourceGroupName,
    factoryName,
    datasetName,
    dataset,
  );
  console.log(result);
}

To use the Azure SDK library in your project, see this documentation. To provide feedback on this code sample, open a GitHub issue

dotnet

using System;
using System.Threading.Tasks;
using Azure;
using Azure.Core;
using Azure.Core.Expressions.DataFactory;
using Azure.Identity;
using Azure.ResourceManager;
using Azure.ResourceManager.DataFactory;
using Azure.ResourceManager.DataFactory.Models;

// Generated from example definition: specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/examples/Datasets_Create.json
// this example is just showing the usage of "Datasets_CreateOrUpdate" operation, for the dependent resources, they will have to be created separately.

// get your azure access token, for more details of how Azure SDK get your access token, please refer to https://learn.microsoft.com/en-us/dotnet/azure/sdk/authentication?tabs=command-line
TokenCredential cred = new DefaultAzureCredential();
// authenticate your client
ArmClient client = new ArmClient(cred);

// this example assumes you already have this DataFactoryResource created on azure
// for more information of creating DataFactoryResource, please refer to the document of DataFactoryResource
string subscriptionId = "12345678-1234-1234-1234-12345678abc";
string resourceGroupName = "exampleResourceGroup";
string factoryName = "exampleFactoryName";
ResourceIdentifier dataFactoryResourceId = DataFactoryResource.CreateResourceIdentifier(subscriptionId, resourceGroupName, factoryName);
DataFactoryResource dataFactory = client.GetDataFactoryResource(dataFactoryResourceId);

// get the collection of this DataFactoryDatasetResource
DataFactoryDatasetCollection collection = dataFactory.GetDataFactoryDatasets();

// invoke the operation
string datasetName = "exampleDataset";
DataFactoryDatasetData data = new DataFactoryDatasetData(new AzureBlobDataset(new DataFactoryLinkedServiceReference("LinkedServiceReference", "exampleLinkedService"))
{
    FolderPath = DataFactoryElement<string>.FromExpression("@dataset().MyFolderPath"),
    FileName = DataFactoryElement<string>.FromExpression("@dataset().MyFileName"),
    Format = new DatasetTextFormat(),
    Parameters =
    {
    ["MyFileName"] = new EntityParameterSpecification(EntityParameterType.String),
    ["MyFolderPath"] = new EntityParameterSpecification(EntityParameterType.String),
    },
});
ArmOperation<DataFactoryDatasetResource> lro = await collection.CreateOrUpdateAsync(WaitUntil.Completed, datasetName, data);
DataFactoryDatasetResource result = lro.Value;

// the variable result is a resource, you could call other operations on this instance as well
// but just for demo, we get its data from this resource instance
DataFactoryDatasetData resourceData = result.Data;
// for demo we just print out the id
Console.WriteLine($"Succeeded on id: {resourceData.Id}");

To use the Azure SDK library in your project, see this documentation. To provide feedback on this code sample, open a GitHub issue

Sample Response

Status code:

200

Date: Sat, 16 Jun 2018 00:37:38 GMT
X-Content-Type-Options: nosniff
x-ms-ratelimit-remaining-subscription-writes: 1194
x-ms-request-id: ce95d6dd-c04d-4b02-b7ad-fe79c9b26df0
x-ms-correlation-request-id: ce95d6dd-c04d-4b02-b7ad-fe79c9b26df0

Response Body

{
  "id": "/subscriptions/12345678-1234-1234-1234-12345678abc/resourceGroups/exampleResourceGroup/providers/Microsoft.DataFactory/factories/exampleFactoryName/datasets/exampleDataset",
  "name": "exampleDataset",
  "type": "Microsoft.DataFactory/factories/datasets",
  "properties": {
    "type": "AzureBlob",
    "schema": [
      {
        "name": "col1",
        "type": "INT_32"
      },
      {
        "name": "col2",
        "type": "Decimal",
        "precision": "38",
        "scale": "2"
      }
    ],
    "typeProperties": {
      "folderPath": {
        "value": "@dataset().MyFolderPath",
        "type": "Expression"
      },
      "fileName": {
        "value": "@dataset().MyFileName",
        "type": "Expression"
      },
      "format": {
        "type": "TextFormat"
      }
    },
    "linkedServiceName": {
      "referenceName": "exampleLinkedService",
      "type": "LinkedServiceReference"
    },
    "parameters": {
      "MyFolderPath": {
        "type": "String"
      },
      "MyFileName": {
        "type": "String"
      }
    }
  },
  "etag": "0a0066d4-0000-0000-0000-5b245bd20000"
}

Datasets_Update

Sample Request

HTTP

PUT https://management.azure.com/subscriptions/12345678-1234-1234-1234-12345678abc/resourceGroups/exampleResourceGroup/providers/Microsoft.DataFactory/factories/exampleFactoryName/datasets/exampleDataset?api-version=2018-06-01

{
  "properties": {
    "type": "AzureBlob",
    "typeProperties": {
      "folderPath": {
        "value": "@dataset().MyFolderPath",
        "type": "Expression"
      },
      "fileName": {
        "value": "@dataset().MyFileName",
        "type": "Expression"
      },
      "format": {
        "type": "TextFormat"
      }
    },
    "description": "Example description",
    "linkedServiceName": {
      "referenceName": "exampleLinkedService",
      "type": "LinkedServiceReference"
    },
    "parameters": {
      "MyFolderPath": {
        "type": "String"
      },
      "MyFileName": {
        "type": "String"
      }
    }
  }
}

Java

import com.azure.core.management.serializer.SerializerFactory;
import com.azure.core.util.serializer.SerializerEncoding;
import com.azure.resourcemanager.datafactory.models.AzureBlobDataset;
import com.azure.resourcemanager.datafactory.models.DatasetResource;
import com.azure.resourcemanager.datafactory.models.LinkedServiceReference;
import com.azure.resourcemanager.datafactory.models.ParameterSpecification;
import com.azure.resourcemanager.datafactory.models.ParameterType;
import com.azure.resourcemanager.datafactory.models.TextFormat;
import java.io.IOException;
import java.util.HashMap;
import java.util.Map;

/**
 * Samples for Datasets CreateOrUpdate.
 */
public final class Main {
    /*
     * x-ms-original-file:
     * specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/examples/Datasets_Update.json
     */
    /**
     * Sample code: Datasets_Update.
     * 
     * @param manager Entry point to DataFactoryManager.
     */
    public static void datasetsUpdate(com.azure.resourcemanager.datafactory.DataFactoryManager manager)
        throws IOException {
        DatasetResource resource = manager.datasets().getWithResponse("exampleResourceGroup", "exampleFactoryName",
            "exampleDataset", null, com.azure.core.util.Context.NONE).getValue();
        resource.update().withProperties(new AzureBlobDataset().withDescription("Example description")
            .withLinkedServiceName(new LinkedServiceReference().withReferenceName("exampleLinkedService"))
            .withParameters(mapOf("MyFileName", new ParameterSpecification().withType(ParameterType.STRING),
                "MyFolderPath", new ParameterSpecification().withType(ParameterType.STRING)))
            .withFolderPath(SerializerFactory.createDefaultManagementSerializerAdapter().deserialize(
                "{\"type\":\"Expression\",\"value\":\"@dataset().MyFolderPath\"}", Object.class,
                SerializerEncoding.JSON))
            .withFileName(SerializerFactory.createDefaultManagementSerializerAdapter().deserialize(
                "{\"type\":\"Expression\",\"value\":\"@dataset().MyFileName\"}", Object.class, SerializerEncoding.JSON))
            .withFormat(new TextFormat())).apply();
    }

    // Use "Map.of" if available
    @SuppressWarnings("unchecked")
    private static <T> Map<String, T> mapOf(Object... inputs) {
        Map<String, T> map = new HashMap<>();
        for (int i = 0; i < inputs.length; i += 2) {
            String key = (String) inputs[i];
            T value = (T) inputs[i + 1];
            map.put(key, value);
        }
        return map;
    }
}

To use the Azure SDK library in your project, see this documentation. To provide feedback on this code sample, open a GitHub issue

Python

from azure.identity import DefaultAzureCredential
from azure.mgmt.datafactory import DataFactoryManagementClient

"""
# PREREQUISITES
    pip install azure-identity
    pip install azure-mgmt-datafactory
# USAGE
    python datasets_update.py

    Before run the sample, please set the values of the client ID, tenant ID and client secret
    of the AAD application as environment variables: AZURE_CLIENT_ID, AZURE_TENANT_ID,
    AZURE_CLIENT_SECRET. For more info about how to get the value, please see:
    https://docs.microsoft.com/azure/active-directory/develop/howto-create-service-principal-portal
"""


def main():
    client = DataFactoryManagementClient(
        credential=DefaultAzureCredential(),
        subscription_id="12345678-1234-1234-1234-12345678abc",
    )

    response = client.datasets.create_or_update(
        resource_group_name="exampleResourceGroup",
        factory_name="exampleFactoryName",
        dataset_name="exampleDataset",
        dataset={
            "properties": {
                "description": "Example description",
                "linkedServiceName": {"referenceName": "exampleLinkedService", "type": "LinkedServiceReference"},
                "parameters": {"MyFileName": {"type": "String"}, "MyFolderPath": {"type": "String"}},
                "type": "AzureBlob",
                "typeProperties": {
                    "fileName": {"type": "Expression", "value": "@dataset().MyFileName"},
                    "folderPath": {"type": "Expression", "value": "@dataset().MyFolderPath"},
                    "format": {"type": "TextFormat"},
                },
            }
        },
    )
    print(response)


# x-ms-original-file: specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/examples/Datasets_Update.json
if __name__ == "__main__":
    main()

To use the Azure SDK library in your project, see this documentation. To provide feedback on this code sample, open a GitHub issue

Go

package armdatafactory_test

import (
	"context"
	"log"

	"github.com/Azure/azure-sdk-for-go/sdk/azcore/to"
	"github.com/Azure/azure-sdk-for-go/sdk/azidentity"
	"github.com/Azure/azure-sdk-for-go/sdk/resourcemanager/datafactory/armdatafactory/v6"
)

// Generated from example definition: https://github.com/Azure/azure-rest-api-specs/blob/01a71545e82bb98b8137d3038150c436d46a59ed/specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/examples/Datasets_Update.json
func ExampleDatasetsClient_CreateOrUpdate_datasetsUpdate() {
	cred, err := azidentity.NewDefaultAzureCredential(nil)
	if err != nil {
		log.Fatalf("failed to obtain a credential: %v", err)
	}
	ctx := context.Background()
	clientFactory, err := armdatafactory.NewClientFactory("<subscription-id>", cred, nil)
	if err != nil {
		log.Fatalf("failed to create client: %v", err)
	}
	res, err := clientFactory.NewDatasetsClient().CreateOrUpdate(ctx, "exampleResourceGroup", "exampleFactoryName", "exampleDataset", armdatafactory.DatasetResource{
		Properties: &armdatafactory.AzureBlobDataset{
			Type:        to.Ptr("AzureBlob"),
			Description: to.Ptr("Example description"),
			LinkedServiceName: &armdatafactory.LinkedServiceReference{
				Type:          to.Ptr(armdatafactory.LinkedServiceReferenceTypeLinkedServiceReference),
				ReferenceName: to.Ptr("exampleLinkedService"),
			},
			Parameters: map[string]*armdatafactory.ParameterSpecification{
				"MyFileName": {
					Type: to.Ptr(armdatafactory.ParameterTypeString),
				},
				"MyFolderPath": {
					Type: to.Ptr(armdatafactory.ParameterTypeString),
				},
			},
			TypeProperties: &armdatafactory.AzureBlobDatasetTypeProperties{
				Format: &armdatafactory.TextFormat{
					Type: to.Ptr("TextFormat"),
				},
				FileName: map[string]any{
					"type":  "Expression",
					"value": "@dataset().MyFileName",
				},
				FolderPath: map[string]any{
					"type":  "Expression",
					"value": "@dataset().MyFolderPath",
				},
			},
		},
	}, &armdatafactory.DatasetsClientCreateOrUpdateOptions{IfMatch: nil})
	if err != nil {
		log.Fatalf("failed to finish the request: %v", err)
	}
	// You could use response here. We use blank identifier for just demo purposes.
	_ = res
	// If the HTTP response code is 200 as defined in example definition, your response structure would look as follows. Please pay attention that all the values in the output are fake values for just demo purposes.
	// res.DatasetResource = armdatafactory.DatasetResource{
	// 	Name: to.Ptr("exampleDataset"),
	// 	Type: to.Ptr("Microsoft.DataFactory/factories/datasets"),
	// 	Etag: to.Ptr("0a0068d4-0000-0000-0000-5b245bd30000"),
	// 	ID: to.Ptr("/subscriptions/12345678-1234-1234-1234-12345678abc/resourceGroups/exampleResourceGroup/providers/Microsoft.DataFactory/factories/exampleFactoryName/datasets/exampleDataset"),
	// 	Properties: &armdatafactory.AzureBlobDataset{
	// 		Type: to.Ptr("AzureBlob"),
	// 		Description: to.Ptr("Example description"),
	// 		LinkedServiceName: &armdatafactory.LinkedServiceReference{
	// 			Type: to.Ptr(armdatafactory.LinkedServiceReferenceTypeLinkedServiceReference),
	// 			ReferenceName: to.Ptr("exampleLinkedService"),
	// 		},
	// 		Parameters: map[string]*armdatafactory.ParameterSpecification{
	// 			"MyFileName": &armdatafactory.ParameterSpecification{
	// 				Type: to.Ptr(armdatafactory.ParameterTypeString),
	// 			},
	// 			"MyFolderPath": &armdatafactory.ParameterSpecification{
	// 				Type: to.Ptr(armdatafactory.ParameterTypeString),
	// 			},
	// 		},
	// 		TypeProperties: &armdatafactory.AzureBlobDatasetTypeProperties{
	// 			Format: &armdatafactory.TextFormat{
	// 				Type: to.Ptr("TextFormat"),
	// 			},
	// 			FileName: map[string]any{
	// 				"type": "Expression",
	// 				"value": "@dataset().MyFileName",
	// 			},
	// 			FolderPath: map[string]any{
	// 				"type": "Expression",
	// 				"value": "@dataset().MyFolderPath",
	// 			},
	// 		},
	// 	},
	// }
}

To use the Azure SDK library in your project, see this documentation. To provide feedback on this code sample, open a GitHub issue

JavaScript

const { DataFactoryManagementClient } = require("@azure/arm-datafactory");
const { DefaultAzureCredential } = require("@azure/identity");

/**
 * This sample demonstrates how to Creates or updates a dataset.
 *
 * @summary Creates or updates a dataset.
 * x-ms-original-file: specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/examples/Datasets_Update.json
 */
async function datasetsUpdate() {
  const subscriptionId =
    process.env["DATAFACTORY_SUBSCRIPTION_ID"] || "12345678-1234-1234-1234-12345678abc";
  const resourceGroupName = process.env["DATAFACTORY_RESOURCE_GROUP"] || "exampleResourceGroup";
  const factoryName = "exampleFactoryName";
  const datasetName = "exampleDataset";
  const dataset = {
    properties: {
      type: "AzureBlob",
      format: { type: "TextFormat" },
      description: "Example description",
      fileName: { type: "Expression", value: "@dataset().MyFileName" },
      folderPath: { type: "Expression", value: "@dataset().MyFolderPath" },
      linkedServiceName: {
        type: "LinkedServiceReference",
        referenceName: "exampleLinkedService",
      },
      parameters: {
        myFileName: { type: "String" },
        myFolderPath: { type: "String" },
      },
    },
  };
  const credential = new DefaultAzureCredential();
  const client = new DataFactoryManagementClient(credential, subscriptionId);
  const result = await client.datasets.createOrUpdate(
    resourceGroupName,
    factoryName,
    datasetName,
    dataset,
  );
  console.log(result);
}

To use the Azure SDK library in your project, see this documentation. To provide feedback on this code sample, open a GitHub issue

dotnet

using System;
using System.Threading.Tasks;
using Azure;
using Azure.Core;
using Azure.Core.Expressions.DataFactory;
using Azure.Identity;
using Azure.ResourceManager;
using Azure.ResourceManager.DataFactory;
using Azure.ResourceManager.DataFactory.Models;

// Generated from example definition: specification/datafactory/resource-manager/Microsoft.DataFactory/stable/2018-06-01/examples/Datasets_Update.json
// this example is just showing the usage of "Datasets_CreateOrUpdate" operation, for the dependent resources, they will have to be created separately.

// get your azure access token, for more details of how Azure SDK get your access token, please refer to https://learn.microsoft.com/en-us/dotnet/azure/sdk/authentication?tabs=command-line
TokenCredential cred = new DefaultAzureCredential();
// authenticate your client
ArmClient client = new ArmClient(cred);

// this example assumes you already have this DataFactoryResource created on azure
// for more information of creating DataFactoryResource, please refer to the document of DataFactoryResource
string subscriptionId = "12345678-1234-1234-1234-12345678abc";
string resourceGroupName = "exampleResourceGroup";
string factoryName = "exampleFactoryName";
ResourceIdentifier dataFactoryResourceId = DataFactoryResource.CreateResourceIdentifier(subscriptionId, resourceGroupName, factoryName);
DataFactoryResource dataFactory = client.GetDataFactoryResource(dataFactoryResourceId);

// get the collection of this DataFactoryDatasetResource
DataFactoryDatasetCollection collection = dataFactory.GetDataFactoryDatasets();

// invoke the operation
string datasetName = "exampleDataset";
DataFactoryDatasetData data = new DataFactoryDatasetData(new AzureBlobDataset(new DataFactoryLinkedServiceReference("LinkedServiceReference", "exampleLinkedService"))
{
    FolderPath = DataFactoryElement<string>.FromExpression("@dataset().MyFolderPath"),
    FileName = DataFactoryElement<string>.FromExpression("@dataset().MyFileName"),
    Format = new DatasetTextFormat(),
    Description = "Example description",
    Parameters =
    {
    ["MyFileName"] = new EntityParameterSpecification(EntityParameterType.String),
    ["MyFolderPath"] = new EntityParameterSpecification(EntityParameterType.String),
    },
});
ArmOperation<DataFactoryDatasetResource> lro = await collection.CreateOrUpdateAsync(WaitUntil.Completed, datasetName, data);
DataFactoryDatasetResource result = lro.Value;

// the variable result is a resource, you could call other operations on this instance as well
// but just for demo, we get its data from this resource instance
DataFactoryDatasetData resourceData = result.Data;
// for demo we just print out the id
Console.WriteLine($"Succeeded on id: {resourceData.Id}");

To use the Azure SDK library in your project, see this documentation. To provide feedback on this code sample, open a GitHub issue

Sample Response

Status code:

200

Date: Sat, 16 Jun 2018 00:37:39 GMT
X-Content-Type-Options: nosniff
x-ms-ratelimit-remaining-subscription-writes: 1193
x-ms-request-id: e2e7f6be-e7ee-4aae-943f-6ff799e034f2
x-ms-correlation-request-id: e2e7f6be-e7ee-4aae-943f-6ff799e034f2

Response Body

{
  "id": "/subscriptions/12345678-1234-1234-1234-12345678abc/resourceGroups/exampleResourceGroup/providers/Microsoft.DataFactory/factories/exampleFactoryName/datasets/exampleDataset",
  "name": "exampleDataset",
  "type": "Microsoft.DataFactory/factories/datasets",
  "properties": {
    "type": "AzureBlob",
    "typeProperties": {
      "folderPath": {
        "value": "@dataset().MyFolderPath",
        "type": "Expression"
      },
      "fileName": {
        "value": "@dataset().MyFileName",
        "type": "Expression"
      },
      "format": {
        "type": "TextFormat"
      }
    },
    "description": "Example description",
    "linkedServiceName": {
      "referenceName": "exampleLinkedService",
      "type": "LinkedServiceReference"
    },
    "parameters": {
      "MyFolderPath": {
        "type": "String"
      },
      "MyFileName": {
        "type": "String"
      }
    }
  },
  "etag": "0a0068d4-0000-0000-0000-5b245bd30000"
}

Definitions

Name	Description
AmazonMWSObjectDataset	Amazon Marketplace Web Service dataset.
AmazonRdsForOracleTableDataset	The AmazonRdsForOracle database dataset.
AmazonRdsForSqlServerTableDataset	The Amazon RDS for SQL Server dataset.
AmazonRedshiftTableDataset	The Amazon Redshift table dataset.
AmazonS3Dataset	A single Amazon Simple Storage Service (S3) object or a set of S3 objects.
AvroDataset	Avro dataset.
AzureBlobDataset	The Azure Blob storage.
AzureBlobFSDataset	The Azure Data Lake Storage Gen2 storage.
AzureDatabricksDeltaLakeDataset	Azure Databricks Delta Lake dataset.
AzureDataExplorerTableDataset	The Azure Data Explorer (Kusto) dataset.
AzureDataLakeStoreDataset	Azure Data Lake Store dataset.
AzureMariaDBTableDataset	Azure Database for MariaDB dataset.
AzureMySqlTableDataset	The Azure MySQL database dataset.
AzurePostgreSqlTableDataset	Azure PostgreSQL dataset.
AzureSearchIndexDataset	The Azure Search Index.
AzureSqlDWTableDataset	The Azure SQL Data Warehouse dataset.
AzureSqlMITableDataset	The Azure SQL Managed Instance dataset.
AzureSqlTableDataset	The Azure SQL Server database dataset.
AzureTableDataset	The Azure Table storage dataset.
BinaryDataset	Binary dataset.
CassandraTableDataset	The Cassandra database dataset.
CloudError	The object that defines the structure of an Azure Data Factory error response.
CommonDataServiceForAppsEntityDataset	The Common Data Service for Apps entity dataset.
ConcurObjectDataset	Concur Service dataset.
CosmosDbMongoDbApiCollectionDataset	The CosmosDB (MongoDB API) database dataset.
CosmosDbSqlApiCollectionDataset	Microsoft Azure CosmosDB (SQL API) Collection dataset.
CouchbaseTableDataset	Couchbase server dataset.
DatasetCompression	The compression method used on a dataset.
DatasetResource	Dataset resource type.
Db2TableDataset	The Db2 table dataset.
DelimitedTextDataset	Delimited text dataset.
DocumentDbCollectionDataset	Microsoft Azure Document Database Collection dataset.
DrillTableDataset	Drill server dataset.
DynamicsAXResourceDataset	The path of the Dynamics AX OData entity.
DynamicsCrmEntityDataset	The Dynamics CRM entity dataset.
DynamicsEntityDataset	The Dynamics entity dataset.
EloquaObjectDataset	Eloqua server dataset.
ExcelDataset	Excel dataset.
FileShareDataset	An on-premises file system dataset.
Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
GoogleAdWordsObjectDataset	Google AdWords service dataset.
GoogleBigQueryObjectDataset	Google BigQuery service dataset.
GoogleBigQueryV2ObjectDataset	Google BigQuery service dataset.
GreenplumTableDataset	Greenplum Database dataset.
HBaseObjectDataset	HBase server dataset.
HiveObjectDataset	Hive Server dataset.
HttpDataset	A file in an HTTP web server.
HubspotObjectDataset	Hubspot Service dataset.
ImpalaObjectDataset	Impala server dataset.
InformixTableDataset	The Informix table dataset.
JiraObjectDataset	Jira Service dataset.
JsonDataset	Json dataset.
LakeHouseTableDataset	Microsoft Fabric LakeHouse Table.
LinkedServiceReference	Linked service reference type.
MagentoObjectDataset	Magento server dataset.
MariaDBTableDataset	MariaDB server dataset.
MarketoObjectDataset	Marketo server dataset.
MicrosoftAccessTableDataset	The Microsoft Access table dataset.
MongoDbAtlasCollectionDataset	The MongoDB Atlas database dataset.
MongoDbCollectionDataset	The MongoDB database dataset.
MongoDbV2CollectionDataset	The MongoDB database dataset.
MySqlTableDataset	The MySQL table dataset.
NetezzaTableDataset	Netezza dataset.
ODataResourceDataset	The Open Data Protocol (OData) resource dataset.
OdbcTableDataset	The ODBC table dataset.
Office365Dataset	The Office365 account.
OracleServiceCloudObjectDataset	Oracle Service Cloud dataset.
OracleTableDataset	The on-premises Oracle database dataset.
OrcDataset	ORC dataset.
ParameterSpecification	Definition of a single parameter for an entity.
ParameterType	Parameter type.
ParquetDataset	Parquet dataset.
PaypalObjectDataset	Paypal Service dataset.
PhoenixObjectDataset	Phoenix server dataset.
PostgreSqlTableDataset	The PostgreSQL table dataset.
PostgreSqlV2TableDataset	The PostgreSQLV2 table dataset.
PrestoObjectDataset	Presto server dataset.
QuickBooksObjectDataset	QuickBooks server dataset.
RelationalTableDataset	The relational table dataset.
ResponsysObjectDataset	Responsys dataset.
RestResourceDataset	A Rest service dataset.
SalesforceMarketingCloudObjectDataset	Salesforce Marketing Cloud dataset.
SalesforceObjectDataset	The Salesforce object dataset.
SalesforceServiceCloudObjectDataset	The Salesforce Service Cloud object dataset.
SalesforceServiceCloudV2ObjectDataset	The Salesforce Service Cloud V2 object dataset.
SalesforceV2ObjectDataset	The Salesforce V2 object dataset.
SapBwCubeDataset	The SAP BW cube dataset.
SapCloudForCustomerResourceDataset	The path of the SAP Cloud for Customer OData entity.
SapEccResourceDataset	The path of the SAP ECC OData entity.
SapHanaTableDataset	SAP HANA Table properties.
SapOdpResourceDataset	SAP ODP Resource properties.
SapOpenHubTableDataset	Sap Business Warehouse Open Hub Destination Table properties.
SapTableResourceDataset	SAP Table Resource properties.
ServiceNowObjectDataset	ServiceNow server dataset.
ServiceNowV2ObjectDataset	ServiceNowV2 server dataset.
SharePointOnlineListResourceDataset	The sharepoint online list resource dataset.
ShopifyObjectDataset	Shopify Service dataset.
SnowflakeDataset	The snowflake dataset.
SnowflakeV2Dataset	The snowflake dataset.
SparkObjectDataset	Spark Server dataset.
SqlServerTableDataset	The on-premises SQL Server dataset.
SquareObjectDataset	Square Service dataset.
SybaseTableDataset	The Sybase table dataset.
TeradataTableDataset	The Teradata database dataset.
Type	Linked service reference type.
VerticaTableDataset	Vertica dataset.
WarehouseTableDataset	Microsoft Fabric Warehouse dataset.
WebTableDataset	The dataset points to a HTML table in the web page.
XeroObjectDataset	Xero Service dataset.
XmlDataset	Xml dataset.
ZohoObjectDataset	Zoho server dataset.

AmazonMWSObjectDataset

Amazon Marketplace Web Service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AmazonMWSObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

AmazonRdsForOracleTableDataset

The AmazonRdsForOracle database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AmazonRdsForOracleTable	Type of dataset.
typeProperties.schema	object	The schema name of the AmazonRdsForOracle database. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the AmazonRdsForOracle database. Type: string (or Expression with resultType string).

AmazonRdsForSqlServerTableDataset

The Amazon RDS for SQL Server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AmazonRdsForSqlServerTable	Type of dataset.
typeProperties.schema	object	The schema name of the SQL Server dataset. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the SQL Server dataset. Type: string (or Expression with resultType string).

AmazonRedshiftTableDataset

The Amazon Redshift table dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AmazonRedshiftTable	Type of dataset.
typeProperties.schema	object	The Amazon Redshift schema name. Type: string (or Expression with resultType string).
typeProperties.table	object	The Amazon Redshift table name. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

AmazonS3Dataset

A single Amazon Simple Storage Service (S3) object or a set of S3 objects.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AmazonS3Object	Type of dataset.
typeProperties.bucketName	object	The name of the Amazon S3 bucket. Type: string (or Expression with resultType string).
typeProperties.compression	DatasetCompression	The data compression method used for the Amazon S3 object.
typeProperties.format	DatasetStorageFormat	The format of files.
typeProperties.key	object	The key of the Amazon S3 object. Type: string (or Expression with resultType string).
typeProperties.modifiedDatetimeEnd	object	The end of S3 object's modified datetime. Type: string (or Expression with resultType string).
typeProperties.modifiedDatetimeStart	object	The start of S3 object's modified datetime. Type: string (or Expression with resultType string).
typeProperties.prefix	object	The prefix filter for the S3 object name. Type: string (or Expression with resultType string).
typeProperties.version	object	The version for the S3 object. Type: string (or Expression with resultType string).

AvroDataset

Avro dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: Avro	Type of dataset.
typeProperties.avroCompressionCodec	object	The data avroCompressionCodec. Type: string (or Expression with resultType string).
typeProperties.avroCompressionLevel	integer
typeProperties.location	DatasetLocation	The location of the avro storage.

AzureBlobDataset

The Azure Blob storage.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureBlob	Type of dataset.
typeProperties.compression	DatasetCompression	The data compression method used for the blob storage.
typeProperties.fileName	object	The name of the Azure Blob. Type: string (or Expression with resultType string).
typeProperties.folderPath	object	The path of the Azure Blob storage. Type: string (or Expression with resultType string).
typeProperties.format	DatasetStorageFormat	The format of the Azure Blob storage.
typeProperties.modifiedDatetimeEnd	object	The end of Azure Blob's modified datetime. Type: string (or Expression with resultType string).
typeProperties.modifiedDatetimeStart	object	The start of Azure Blob's modified datetime. Type: string (or Expression with resultType string).
typeProperties.tableRootLocation	object	The root of blob path. Type: string (or Expression with resultType string).

AzureBlobFSDataset

The Azure Data Lake Storage Gen2 storage.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureBlobFSFile	Type of dataset.
typeProperties.compression	DatasetCompression	The data compression method used for the blob storage.
typeProperties.fileName	object	The name of the Azure Data Lake Storage Gen2. Type: string (or Expression with resultType string).
typeProperties.folderPath	object	The path of the Azure Data Lake Storage Gen2 storage. Type: string (or Expression with resultType string).
typeProperties.format	DatasetStorageFormat	The format of the Azure Data Lake Storage Gen2 storage.

AzureDatabricksDeltaLakeDataset

Azure Databricks Delta Lake dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureDatabricksDeltaLakeDataset	Type of dataset.
typeProperties.database	object	The database name of delta table. Type: string (or Expression with resultType string).
typeProperties.table	object	The name of delta table. Type: string (or Expression with resultType string).

AzureDataExplorerTableDataset

The Azure Data Explorer (Kusto) dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureDataExplorerTable	Type of dataset.
typeProperties.table	object	The table name of the Azure Data Explorer database. Type: string (or Expression with resultType string).

AzureDataLakeStoreDataset

Azure Data Lake Store dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureDataLakeStoreFile	Type of dataset.
typeProperties.compression	DatasetCompression	The data compression method used for the item(s) in the Azure Data Lake Store.
typeProperties.fileName	object	The name of the file in the Azure Data Lake Store. Type: string (or Expression with resultType string).
typeProperties.folderPath	object	Path to the folder in the Azure Data Lake Store. Type: string (or Expression with resultType string).
typeProperties.format	DatasetStorageFormat	The format of the Data Lake Store.

AzureMariaDBTableDataset

Azure Database for MariaDB dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureMariaDBTable	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

AzureMySqlTableDataset

The Azure MySQL database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureMySqlTable	Type of dataset.
typeProperties.table	object	The name of Azure MySQL database table. Type: string (or Expression with resultType string).
typeProperties.tableName	object	The Azure MySQL database table name. Type: string (or Expression with resultType string).

AzurePostgreSqlTableDataset

Azure PostgreSQL dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzurePostgreSqlTable	Type of dataset.
typeProperties.schema	object	The schema name of the Azure PostgreSQL database. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Azure PostgreSQL database. Type: string (or Expression with resultType string).
typeProperties.tableName	object	The table name of the Azure PostgreSQL database which includes both schema and table. Type: string (or Expression with resultType string).

AzureSearchIndexDataset

The Azure Search Index.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureSearchIndex	Type of dataset.
typeProperties.indexName	object	The name of the Azure Search Index. Type: string (or Expression with resultType string).

AzureSqlDWTableDataset

The Azure SQL Data Warehouse dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureSqlDWTable	Type of dataset.
typeProperties.schema	object	The schema name of the Azure SQL Data Warehouse. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Azure SQL Data Warehouse. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

AzureSqlMITableDataset

The Azure SQL Managed Instance dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureSqlMITable	Type of dataset.
typeProperties.schema	object	The schema name of the Azure SQL Managed Instance. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Azure SQL Managed Instance dataset. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

AzureSqlTableDataset

The Azure SQL Server database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureSqlTable	Type of dataset.
typeProperties.schema	object	The schema name of the Azure SQL database. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Azure SQL database. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

AzureTableDataset

The Azure Table storage dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: AzureTable	Type of dataset.
typeProperties.tableName	object	The table name of the Azure Table storage. Type: string (or Expression with resultType string).

BinaryDataset

Binary dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: Binary	Type of dataset.
typeProperties.compression	DatasetCompression	The data compression method used for the binary dataset.
typeProperties.location	DatasetLocation	The location of the Binary storage.

CassandraTableDataset

The Cassandra database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: CassandraTable	Type of dataset.
typeProperties.keyspace	object	The keyspace of the Cassandra database. Type: string (or Expression with resultType string).
typeProperties.tableName	object	The table name of the Cassandra database. Type: string (or Expression with resultType string).

CloudError

The object that defines the structure of an Azure Data Factory error response.

Name	Type	Description
error.code	string	Error code.
error.details	CloudError[]	Array with additional error details.
error.message	string	Error message.
error.target	string	Property name/path in request associated with error.

CommonDataServiceForAppsEntityDataset

The Common Data Service for Apps entity dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: CommonDataServiceForAppsEntity	Type of dataset.
typeProperties.entityName	object	The logical name of the entity. Type: string (or Expression with resultType string).

ConcurObjectDataset

Concur Service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: ConcurObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

CosmosDbMongoDbApiCollectionDataset

The CosmosDB (MongoDB API) database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: CosmosDbMongoDbApiCollection	Type of dataset.
typeProperties.collection	object	The collection name of the CosmosDB (MongoDB API) database. Type: string (or Expression with resultType string).

CosmosDbSqlApiCollectionDataset

Microsoft Azure CosmosDB (SQL API) Collection dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: CosmosDbSqlApiCollection	Type of dataset.
typeProperties.collectionName	object	CosmosDB (SQL API) collection name. Type: string (or Expression with resultType string).

CouchbaseTableDataset

Couchbase server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: CouchbaseTable	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

DatasetCompression

The compression method used on a dataset.

Name	Type	Description
level	object	The dataset compression level. Type: string (or Expression with resultType string).
type	object	Type of dataset compression. Type: string (or Expression with resultType string).

DatasetResource

Dataset resource type.

Name	Type	Description
etag	string	Etag identifies change in the resource.
id	string	The resource identifier.
name	string	The resource name.
properties	Dataset: AmazonMWSObjectDataset AmazonRdsForOracleTableDataset AmazonRdsForSqlServerTableDataset AmazonRedshiftTableDataset AmazonS3Dataset AvroDataset AzureBlobDataset AzureBlobFSDataset AzureDataExplorerTableDataset AzureDataLakeStoreDataset AzureDatabricksDeltaLakeDataset AzureMariaDBTableDataset AzureMySqlTableDataset AzurePostgreSqlTableDataset AzureSearchIndexDataset AzureSqlDWTableDataset AzureSqlMITableDataset AzureSqlTableDataset AzureTableDataset BinaryDataset CassandraTableDataset CommonDataServiceForAppsEntityDataset ConcurObjectDataset CosmosDbMongoDbApiCollectionDataset CosmosDbSqlApiCollectionDataset CouchbaseTableDataset Db2TableDataset DelimitedTextDataset DocumentDbCollectionDataset DrillTableDataset DynamicsAXResourceDataset DynamicsCrmEntityDataset DynamicsEntityDataset EloquaObjectDataset ExcelDataset FileShareDataset GoogleAdWordsObjectDataset GoogleBigQueryObjectDataset GoogleBigQueryV2ObjectDataset GreenplumTableDataset HBaseObjectDataset HiveObjectDataset HttpDataset HubspotObjectDataset ImpalaObjectDataset InformixTableDataset JiraObjectDataset JsonDataset LakeHouseTableDataset MagentoObjectDataset MariaDBTableDataset MarketoObjectDataset MicrosoftAccessTableDataset MongoDbAtlasCollectionDataset MongoDbCollectionDataset MongoDbV2CollectionDataset MySqlTableDataset NetezzaTableDataset ODataResourceDataset OdbcTableDataset Office365Dataset OracleServiceCloudObjectDataset OracleTableDataset OrcDataset ParquetDataset PaypalObjectDataset PhoenixObjectDataset PostgreSqlTableDataset PostgreSqlV2TableDataset PrestoObjectDataset QuickBooksObjectDataset RelationalTableDataset ResponsysObjectDataset RestResourceDataset SalesforceMarketingCloudObjectDataset SalesforceObjectDataset SalesforceServiceCloudObjectDataset SalesforceServiceCloudV2ObjectDataset SalesforceV2ObjectDataset SapBwCubeDataset SapCloudForCustomerResourceDataset SapEccResourceDataset SapHanaTableDataset SapOdpResourceDataset SapOpenHubTableDataset SapTableResourceDataset ServiceNowObjectDataset ServiceNowV2ObjectDataset SharePointOnlineListResourceDataset ShopifyObjectDataset SnowflakeDataset SnowflakeV2Dataset SparkObjectDataset SqlServerTableDataset SquareObjectDataset SybaseTableDataset TeradataTableDataset VerticaTableDataset WarehouseTableDataset WebTableDataset XeroObjectDataset XmlDataset ZohoObjectDataset	Dataset properties.
type	string	The resource type.

Db2TableDataset

The Db2 table dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: Db2Table	Type of dataset.
typeProperties.schema	object	The Db2 schema name. Type: string (or Expression with resultType string).
typeProperties.table	object	The Db2 table name. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

DelimitedTextDataset

Delimited text dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: DelimitedText	Type of dataset.
typeProperties.columnDelimiter	object	The column delimiter. Type: string (or Expression with resultType string).
typeProperties.compressionCodec	object	The data compressionCodec. Type: string (or Expression with resultType string).
typeProperties.compressionLevel	object	The data compression method used for DelimitedText.
typeProperties.encodingName	object	The code page name of the preferred encoding. If miss, the default value is UTF-8, unless BOM denotes another Unicode encoding. Refer to the name column of the table in the following link to set supported values: https://msdn.microsoft.com/library/system.text.encoding.aspx. Type: string (or Expression with resultType string).
typeProperties.escapeChar	object	The escape character. Type: string (or Expression with resultType string).
typeProperties.firstRowAsHeader	object	When used as input, treat the first row of data as headers. When used as output,write the headers into the output as the first row of data. The default value is false. Type: boolean (or Expression with resultType boolean).
typeProperties.location	DatasetLocation	The location of the delimited text storage.
typeProperties.nullValue	object	The null value string. Type: string (or Expression with resultType string).
typeProperties.quoteChar	object	The quote character. Type: string (or Expression with resultType string).
typeProperties.rowDelimiter	object	The row delimiter. Type: string (or Expression with resultType string).

DocumentDbCollectionDataset

Microsoft Azure Document Database Collection dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: DocumentDbCollection	Type of dataset.
typeProperties.collectionName	object	Document Database collection name. Type: string (or Expression with resultType string).

DrillTableDataset

Drill server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: DrillTable	Type of dataset.
typeProperties.schema	object	The schema name of the Drill. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Drill. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

DynamicsAXResourceDataset

The path of the Dynamics AX OData entity.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: DynamicsAXResource	Type of dataset.
typeProperties.path	object	The path of the Dynamics AX OData entity. Type: string (or Expression with resultType string).

DynamicsCrmEntityDataset

The Dynamics CRM entity dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: DynamicsCrmEntity	Type of dataset.
typeProperties.entityName	object	The logical name of the entity. Type: string (or Expression with resultType string).

DynamicsEntityDataset

The Dynamics entity dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: DynamicsEntity	Type of dataset.
typeProperties.entityName	object	The logical name of the entity. Type: string (or Expression with resultType string).

EloquaObjectDataset

Eloqua server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: EloquaObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

ExcelDataset

Excel dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: Excel	Type of dataset.
typeProperties.compression	DatasetCompression	The data compression method used for the json dataset.
typeProperties.firstRowAsHeader	object	When used as input, treat the first row of data as headers. When used as output,write the headers into the output as the first row of data. The default value is false. Type: boolean (or Expression with resultType boolean).
typeProperties.location	DatasetLocation	The location of the excel storage.
typeProperties.nullValue	object	The null value string. Type: string (or Expression with resultType string).
typeProperties.range	object	The partial data of one sheet. Type: string (or Expression with resultType string).
typeProperties.sheetIndex	object	The sheet index of excel file and default value is 0. Type: integer (or Expression with resultType integer)
typeProperties.sheetName	object	The sheet name of excel file. Type: string (or Expression with resultType string).

FileShareDataset

An on-premises file system dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: FileShare	Type of dataset.
typeProperties.compression	DatasetCompression	The data compression method used for the file system.
typeProperties.fileFilter	object	Specify a filter to be used to select a subset of files in the folderPath rather than all files. Type: string (or Expression with resultType string).
typeProperties.fileName	object	The name of the on-premises file system. Type: string (or Expression with resultType string).
typeProperties.folderPath	object	The path of the on-premises file system. Type: string (or Expression with resultType string).
typeProperties.format	DatasetStorageFormat	The format of the files.
typeProperties.modifiedDatetimeEnd	object	The end of file's modified datetime. Type: string (or Expression with resultType string).
typeProperties.modifiedDatetimeStart	object	The start of file's modified datetime. Type: string (or Expression with resultType string).

Folder

The folder that this Dataset is in. If not specified, Dataset will appear at the root level.

Name	Type	Description
name	string	The name of the folder that this Dataset is in.

GoogleAdWordsObjectDataset

Google AdWords service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: GoogleAdWordsObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

GoogleBigQueryObjectDataset

Google BigQuery service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: GoogleBigQueryObject	Type of dataset.
typeProperties.dataset	object	The database name of the Google BigQuery. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Google BigQuery. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using database + table properties instead.

GoogleBigQueryV2ObjectDataset

Google BigQuery service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: GoogleBigQueryV2Object	Type of dataset.
typeProperties.dataset	object	The database name of the Google BigQuery. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Google BigQuery. Type: string (or Expression with resultType string).

GreenplumTableDataset

Greenplum Database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: GreenplumTable	Type of dataset.
typeProperties.schema	object	The schema name of Greenplum. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of Greenplum. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

HBaseObjectDataset

HBase server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: HBaseObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

HiveObjectDataset

Hive Server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: HiveObject	Type of dataset.
typeProperties.schema	object	The schema name of the Hive. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Hive. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

HttpDataset

A file in an HTTP web server.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: HttpFile	Type of dataset.
typeProperties.additionalHeaders	object	The headers for the HTTP Request. e.g. request-header-name-1:request-header-value-1 ... request-header-name-n:request-header-value-n Type: string (or Expression with resultType string).
typeProperties.compression	DatasetCompression	The data compression method used on files.
typeProperties.format	DatasetStorageFormat	The format of files.
typeProperties.relativeUrl	object	The relative URL based on the URL in the HttpLinkedService refers to an HTTP file Type: string (or Expression with resultType string).
typeProperties.requestBody	object	The body for the HTTP request. Type: string (or Expression with resultType string).
typeProperties.requestMethod	object	The HTTP method for the HTTP request. Type: string (or Expression with resultType string).

HubspotObjectDataset

Hubspot Service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: HubspotObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

ImpalaObjectDataset

Impala server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: ImpalaObject	Type of dataset.
typeProperties.schema	object	The schema name of the Impala. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Impala. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

InformixTableDataset

The Informix table dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: InformixTable	Type of dataset.
typeProperties.tableName	object	The Informix table name. Type: string (or Expression with resultType string).

JiraObjectDataset

Jira Service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: JiraObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

JsonDataset

Json dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: Json	Type of dataset.
typeProperties.compression	DatasetCompression	The data compression method used for the json dataset.
typeProperties.encodingName	object	The code page name of the preferred encoding. If not specified, the default value is UTF-8, unless BOM denotes another Unicode encoding. Refer to the name column of the table in the following link to set supported values: https://msdn.microsoft.com/library/system.text.encoding.aspx. Type: string (or Expression with resultType string).
typeProperties.location	DatasetLocation	The location of the json data storage.

LakeHouseTableDataset

Microsoft Fabric LakeHouse Table.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: LakeHouseTable	Type of dataset.
typeProperties.table	object	The name of Microsoft Fabric LakeHouse Table. Type: string (or Expression with resultType string).

LinkedServiceReference

Linked service reference type.

Name	Type	Description
parameters	object	Arguments for LinkedService.
referenceName	string	Reference LinkedService name.
type	Type	Linked service reference type.

MagentoObjectDataset

Magento server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: MagentoObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

MariaDBTableDataset

MariaDB server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: MariaDBTable	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

MarketoObjectDataset

Marketo server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: MarketoObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

MicrosoftAccessTableDataset

The Microsoft Access table dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: MicrosoftAccessTable	Type of dataset.
typeProperties.tableName	object	The Microsoft Access table name. Type: string (or Expression with resultType string).

MongoDbAtlasCollectionDataset

The MongoDB Atlas database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: MongoDbAtlasCollection	Type of dataset.
typeProperties.collection	object	The collection name of the MongoDB Atlas database. Type: string (or Expression with resultType string).

MongoDbCollectionDataset

The MongoDB database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: MongoDbCollection	Type of dataset.
typeProperties.collectionName	object	The table name of the MongoDB database. Type: string (or Expression with resultType string).

MongoDbV2CollectionDataset

The MongoDB database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: MongoDbV2Collection	Type of dataset.
typeProperties.collection	object	The collection name of the MongoDB database. Type: string (or Expression with resultType string).

MySqlTableDataset

The MySQL table dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: MySqlTable	Type of dataset.
typeProperties.tableName	object	The MySQL table name. Type: string (or Expression with resultType string).

NetezzaTableDataset

Netezza dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: NetezzaTable	Type of dataset.
typeProperties.schema	object	The schema name of the Netezza. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Netezza. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

ODataResourceDataset

The Open Data Protocol (OData) resource dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: ODataResource	Type of dataset.
typeProperties.path	object	The OData resource path. Type: string (or Expression with resultType string).

OdbcTableDataset

The ODBC table dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: OdbcTable	Type of dataset.
typeProperties.tableName	object	The ODBC table name. Type: string (or Expression with resultType string).

Office365Dataset

The Office365 account.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: Office365Table	Type of dataset.
typeProperties.predicate	object	A predicate expression that can be used to filter the specific rows to extract from Office 365. Type: string (or Expression with resultType string).
typeProperties.tableName	object	Name of the dataset to extract from Office 365. Type: string (or Expression with resultType string).

OracleServiceCloudObjectDataset

Oracle Service Cloud dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: OracleServiceCloudObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

OracleTableDataset

The on-premises Oracle database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: OracleTable	Type of dataset.
typeProperties.schema	object	The schema name of the on-premises Oracle database. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the on-premises Oracle database. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

OrcDataset

ORC dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: Orc	Type of dataset.
typeProperties.location	DatasetLocation	The location of the ORC data storage.
typeProperties.orcCompressionCodec	object	The data orcCompressionCodec. Type: string (or Expression with resultType string).

ParameterSpecification

Definition of a single parameter for an entity.

Name	Type	Description
defaultValue	object	Default value of parameter.
type	ParameterType	Parameter type.

ParameterType

Parameter type.

Name	Type	Description
Array	string
Bool	string
Float	string
Int	string
Object	string
SecureString	string
String	string

ParquetDataset

Parquet dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: Parquet	Type of dataset.
typeProperties.compressionCodec	object	The data compressionCodec. Type: string (or Expression with resultType string).
typeProperties.location	DatasetLocation	The location of the parquet storage.

PaypalObjectDataset

Paypal Service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: PaypalObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

PhoenixObjectDataset

Phoenix server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: PhoenixObject	Type of dataset.
typeProperties.schema	object	The schema name of the Phoenix. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Phoenix. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

PostgreSqlTableDataset

The PostgreSQL table dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: PostgreSqlTable	Type of dataset.
typeProperties.schema	object	The PostgreSQL schema name. Type: string (or Expression with resultType string).
typeProperties.table	object	The PostgreSQL table name. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

PostgreSqlV2TableDataset

The PostgreSQLV2 table dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: PostgreSqlV2Table	Type of dataset.
typeProperties.schema	object	The PostgreSQL schema name. Type: string (or Expression with resultType string).
typeProperties.table	object	The PostgreSQL table name. Type: string (or Expression with resultType string).

PrestoObjectDataset

Presto server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: PrestoObject	Type of dataset.
typeProperties.schema	object	The schema name of the Presto. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Presto. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

QuickBooksObjectDataset

QuickBooks server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: QuickBooksObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

RelationalTableDataset

The relational table dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: RelationalTable	Type of dataset.
typeProperties.tableName	object	The relational table name. Type: string (or Expression with resultType string).

ResponsysObjectDataset

Responsys dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: ResponsysObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

RestResourceDataset

A Rest service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: RestResource	Type of dataset.
typeProperties.additionalHeaders	object	The additional HTTP headers in the request to the RESTful API.
typeProperties.paginationRules	object	The pagination rules to compose next page requests.
typeProperties.relativeUrl	object	The relative URL to the resource that the RESTful API provides. Type: string (or Expression with resultType string).
typeProperties.requestBody	object	The HTTP request body to the RESTful API if requestMethod is POST. Type: string (or Expression with resultType string).
typeProperties.requestMethod	object	The HTTP method used to call the RESTful API. The default is GET. Type: string (or Expression with resultType string).

SalesforceMarketingCloudObjectDataset

Salesforce Marketing Cloud dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SalesforceMarketingCloudObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

SalesforceObjectDataset

The Salesforce object dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SalesforceObject	Type of dataset.
typeProperties.objectApiName	object	The Salesforce object API name. Type: string (or Expression with resultType string).

SalesforceServiceCloudObjectDataset

The Salesforce Service Cloud object dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SalesforceServiceCloudObject	Type of dataset.
typeProperties.objectApiName	object	The Salesforce Service Cloud object API name. Type: string (or Expression with resultType string).

SalesforceServiceCloudV2ObjectDataset

The Salesforce Service Cloud V2 object dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SalesforceServiceCloudV2Object	Type of dataset.
typeProperties.objectApiName	object	The Salesforce Service Cloud V2 object API name. Type: string (or Expression with resultType string).
typeProperties.reportId	object	The Salesforce Service Cloud V2 reportId. Type: string (or Expression with resultType string).

SalesforceV2ObjectDataset

The Salesforce V2 object dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SalesforceV2Object	Type of dataset.
typeProperties.objectApiName	object	The Salesforce V2 object API name. Type: string (or Expression with resultType string).
typeProperties.reportId	object	The Salesforce V2 report Id. Type: string (or Expression with resultType string).

SapBwCubeDataset

The SAP BW cube dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SapBwCube	Type of dataset.

SapCloudForCustomerResourceDataset

The path of the SAP Cloud for Customer OData entity.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SapCloudForCustomerResource	Type of dataset.
typeProperties.path	object	The path of the SAP Cloud for Customer OData entity. Type: string (or Expression with resultType string).

SapEccResourceDataset

The path of the SAP ECC OData entity.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SapEccResource	Type of dataset.
typeProperties.path	object	The path of the SAP ECC OData entity. Type: string (or Expression with resultType string).

SapHanaTableDataset

SAP HANA Table properties.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SapHanaTable	Type of dataset.
typeProperties.schema	object	The schema name of SAP HANA. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of SAP HANA. Type: string (or Expression with resultType string).

SapOdpResourceDataset

SAP ODP Resource properties.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SapOdpResource	Type of dataset.
typeProperties.context	object	The context of the SAP ODP Object. Type: string (or Expression with resultType string).
typeProperties.objectName	object	The name of the SAP ODP Object. Type: string (or Expression with resultType string).

SapOpenHubTableDataset

Sap Business Warehouse Open Hub Destination Table properties.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SapOpenHubTable	Type of dataset.
typeProperties.baseRequestId	object	The ID of request for delta loading. Once it is set, only data with requestId larger than the value of this property will be retrieved. The default value is 0. Type: integer (or Expression with resultType integer ).
typeProperties.excludeLastRequest	object	Whether to exclude the records of the last request. The default value is true. Type: boolean (or Expression with resultType boolean).
typeProperties.openHubDestinationName	object	The name of the Open Hub Destination with destination type as Database Table. Type: string (or Expression with resultType string).

SapTableResourceDataset

SAP Table Resource properties.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SapTableResource	Type of dataset.
typeProperties.tableName	object	The name of the SAP Table. Type: string (or Expression with resultType string).

ServiceNowObjectDataset

ServiceNow server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: ServiceNowObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

ServiceNowV2ObjectDataset

ServiceNowV2 server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: ServiceNowV2Object	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

SharePointOnlineListResourceDataset

The sharepoint online list resource dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SharePointOnlineListResource	Type of dataset.
typeProperties.listName	object	The name of the SharePoint Online list. Type: string (or Expression with resultType string).

ShopifyObjectDataset

Shopify Service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: ShopifyObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

SnowflakeDataset

The snowflake dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SnowflakeTable	Type of dataset.
typeProperties.schema	object	The schema name of the Snowflake database. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Snowflake database. Type: string (or Expression with resultType string).

SnowflakeV2Dataset

The snowflake dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SnowflakeV2Table	Type of dataset.
typeProperties.schema	object	The schema name of the Snowflake database. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Snowflake database. Type: string (or Expression with resultType string).

SparkObjectDataset

Spark Server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SparkObject	Type of dataset.
typeProperties.schema	object	The schema name of the Spark. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Spark. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

SqlServerTableDataset

The on-premises SQL Server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SqlServerTable	Type of dataset.
typeProperties.schema	object	The schema name of the SQL Server dataset. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the SQL Server dataset. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

SquareObjectDataset

Square Service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SquareObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

SybaseTableDataset

The Sybase table dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: SybaseTable	Type of dataset.
typeProperties.tableName	object	The Sybase table name. Type: string (or Expression with resultType string).

TeradataTableDataset

The Teradata database dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: TeradataTable	Type of dataset.
typeProperties.database	object	The database name of Teradata. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of Teradata. Type: string (or Expression with resultType string).

Type

Linked service reference type.

Name	Type	Description
LinkedServiceReference	string

VerticaTableDataset

Vertica dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: VerticaTable	Type of dataset.
typeProperties.schema	object	The schema name of the Vertica. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Vertica. Type: string (or Expression with resultType string).
typeProperties.tableName	object	This property will be retired. Please consider using schema + table properties instead.

WarehouseTableDataset

Microsoft Fabric Warehouse dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: WarehouseTable	Type of dataset.
typeProperties.schema	object	The schema name of the Microsoft Fabric Warehouse. Type: string (or Expression with resultType string).
typeProperties.table	object	The table name of the Microsoft Fabric Warehouse. Type: string (or Expression with resultType string).

WebTableDataset

The dataset points to a HTML table in the web page.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: WebTable	Type of dataset.
typeProperties.index	object	The zero-based index of the table in the web page. Type: integer (or Expression with resultType integer), minimum: 0.
typeProperties.path	object	The relative URL to the web page from the linked service URL. Type: string (or Expression with resultType string).

XeroObjectDataset

Xero Service dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: XeroObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).

XmlDataset

Xml dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: Xml	Type of dataset.
typeProperties.compression	DatasetCompression	The data compression method used for the json dataset.
typeProperties.encodingName	object	The code page name of the preferred encoding. If not specified, the default value is UTF-8, unless BOM denotes another Unicode encoding. Refer to the name column of the table in the following link to set supported values: https://msdn.microsoft.com/library/system.text.encoding.aspx. Type: string (or Expression with resultType string).
typeProperties.location	DatasetLocation	The location of the json data storage.
typeProperties.nullValue	object	The null value string. Type: string (or Expression with resultType string).

ZohoObjectDataset

Zoho server dataset.

Name	Type	Description
annotations	object[]	List of tags that can be used for describing the Dataset.
description	string	Dataset description.
folder	Folder	The folder that this Dataset is in. If not specified, Dataset will appear at the root level.
linkedServiceName	LinkedServiceReference	Linked service reference.
parameters	<string,  ParameterSpecification>	Parameters for dataset.
schema	object	Columns that define the physical type schema of the dataset. Type: array (or Expression with resultType array), itemType: DatasetSchemaDataElement.
structure	object	Columns that define the structure of the dataset. Type: array (or Expression with resultType array), itemType: DatasetDataElement.
type	string: ZohoObject	Type of dataset.
typeProperties.tableName	object	The table name. Type: string (or Expression with resultType string).