Streaming Jobs - Create Or Replace

Creates a streaming job or replaces an already existing streaming job.

PUT https://management.azure.com/subscriptions/{subscriptionId}/resourcegroups/{resourceGroupName}/providers/Microsoft.StreamAnalytics/streamingjobs/{jobName}?api-version=2020-03-01

URI Parameters

Name In Required Type Description
jobName
path True

string

The name of the streaming job.

resourceGroupName
path True

string

The name of the resource group. The name is case insensitive.

Regex pattern: ^[-\w\._\(\)]+$

subscriptionId
path True

string

The ID of the target subscription.

api-version
query True

string

The API version to use for this operation.

Request Header

Name Required Type Description
If-Match

string

The ETag of the streaming job. Omit this value to always overwrite the current record set. Specify the last-seen ETag value to prevent accidentally overwriting concurrent changes.

If-None-Match

string

Set to '*' to allow a new streaming job to be created, but to prevent updating an existing record set. Other values will result in a 412 Pre-condition Failed response.

Request Body

Name Type Description
identity

Identity

Describes the system-assigned managed identity assigned to this job that can be used to authenticate with inputs and outputs.

location

string

The geo-location where the resource lives

properties.cluster

ClusterInfo

The cluster which streaming jobs will run on.

properties.compatibilityLevel

CompatibilityLevel

Controls certain runtime behaviors of the streaming job.

properties.contentStoragePolicy

ContentStoragePolicy

Valid values are JobStorageAccount and SystemAccount. If set to JobStorageAccount, this requires the user to also specify jobStorageAccount property. .

properties.dataLocale

string

The data locale of the stream analytics job. Value should be the name of a supported .NET Culture from the set https://msdn.microsoft.com/en-us/library/system.globalization.culturetypes(v=vs.110).aspx. Defaults to 'en-US' if none specified.

properties.eventsLateArrivalMaxDelayInSeconds

integer

The maximum tolerable delay in seconds where events arriving late could be included. Supported range is -1 to 1814399 (20.23:59:59 days) and -1 is used to specify wait indefinitely. If the property is absent, it is interpreted to have a value of -1.

properties.eventsOutOfOrderMaxDelayInSeconds

integer

The maximum tolerable delay in seconds where out-of-order events can be adjusted to be back in order.

properties.eventsOutOfOrderPolicy

EventsOutOfOrderPolicy

Indicates the policy to apply to events that arrive out of order in the input event stream.

properties.functions

Function[]

A list of one or more functions for the streaming job. The name property for each function is required when specifying this property in a PUT request. This property cannot be modify via a PATCH operation. You must use the PATCH API available for the individual transformation.

properties.inputs

Input[]

A list of one or more inputs to the streaming job. The name property for each input is required when specifying this property in a PUT request. This property cannot be modify via a PATCH operation. You must use the PATCH API available for the individual input.

properties.jobStorageAccount

JobStorageAccount

The properties that are associated with an Azure Storage account with MSI

properties.jobType

JobType

Describes the type of the job. Valid modes are Cloud and 'Edge'.

properties.outputErrorPolicy

OutputErrorPolicy

Indicates the policy to apply to events that arrive at the output and cannot be written to the external storage due to being malformed (missing column values, column values of wrong type or size).

properties.outputStartMode

OutputStartMode

This property should only be utilized when it is desired that the job be started immediately upon creation. Value may be JobStartTime, CustomTime, or LastOutputEventTime to indicate whether the starting point of the output event stream should start whenever the job is started, start at a custom user time stamp specified via the outputStartTime property, or start from the last event output time.

properties.outputStartTime

string

Value is either an ISO-8601 formatted time stamp that indicates the starting point of the output event stream, or null to indicate that the output event stream will start whenever the streaming job is started. This property must have a value if outputStartMode is set to CustomTime.

properties.outputs

Output[]

A list of one or more outputs for the streaming job. The name property for each output is required when specifying this property in a PUT request. This property cannot be modify via a PATCH operation. You must use the PATCH API available for the individual output.

properties.sku

Sku

Describes the SKU of the streaming job. Required on PUT (CreateOrReplace) requests.

properties.transformation

Transformation

Indicates the query and the number of streaming units to use for the streaming job. The name property of the transformation is required when specifying this property in a PUT request. This property cannot be modify via a PATCH operation. You must use the PATCH API available for the individual transformation.

tags

object

Resource tags.

Responses

Name Type Description
200 OK

StreamingJob

The streaming job was successfully created or replaced.

Headers

ETag: string

201 Created

StreamingJob

The streaming job was successfully created or replaced.

Headers

ETag: string

Other Status Codes

Error

Error.

Security

azure_auth

Azure Active Directory OAuth2 Flow

Type: oauth2
Flow: implicit
Authorization URL: https://login.microsoftonline.com/common/oauth2/authorize

Scopes

Name Description
user_impersonation impersonate your user account

Examples

Create a complete streaming job (a streaming job with a transformation, at least 1 input and at least 1 output)
Create a streaming job shell (a streaming job with no inputs, outputs, transformation, or functions)

Create a complete streaming job (a streaming job with a transformation, at least 1 input and at least 1 output)

Sample request

PUT https://management.azure.com/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourcegroups/sjrg3276/providers/Microsoft.StreamAnalytics/streamingjobs/sj7804?api-version=2020-03-01

{
  "properties": {
    "sku": {
      "name": "Standard"
    },
    "eventsOutOfOrderPolicy": "Drop",
    "outputErrorPolicy": "Drop",
    "eventsOutOfOrderMaxDelayInSeconds": 0,
    "eventsLateArrivalMaxDelayInSeconds": 5,
    "dataLocale": "en-US",
    "compatibilityLevel": "1.0",
    "inputs": [
      {
        "properties": {
          "type": "Stream",
          "datasource": {
            "type": "Microsoft.Storage/Blob",
            "properties": {
              "storageAccounts": [
                {
                  "accountName": "yourAccountName",
                  "accountKey": "yourAccountKey=="
                }
              ],
              "container": "containerName",
              "pathPattern": ""
            }
          },
          "serialization": {
            "type": "Json",
            "properties": {
              "encoding": "UTF8"
            }
          }
        },
        "name": "inputtest"
      }
    ],
    "transformation": {
      "properties": {
        "streamingUnits": 1,
        "query": "Select Id, Name from inputtest"
      },
      "name": "transformationtest"
    },
    "outputs": [
      {
        "properties": {
          "datasource": {
            "type": "Microsoft.Sql/Server/Database",
            "properties": {
              "server": "serverName",
              "database": "databaseName",
              "user": "<user>",
              "password": "userPassword",
              "table": "tableName"
            }
          }
        },
        "name": "outputtest"
      }
    ],
    "functions": []
  },
  "location": "West US",
  "tags": {
    "key1": "value1",
    "randomKey": "randomValue",
    "key3": "value3"
  }
}

Sample response

ETag: 87551cc5-1290-4d08-afcd-cdaa92e5ade0
{
  "id": "/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourceGroups/sjrg3276/providers/Microsoft.StreamAnalytics/streamingjobs/sj7804",
  "name": "sj7804",
  "type": "Microsoft.StreamAnalytics/streamingjobs",
  "location": "West US",
  "tags": {
    "key1": "value1",
    "randomKey": "randomValue",
    "key3": "value3"
  },
  "properties": {
    "sku": {
      "name": "Standard"
    },
    "jobId": "732e4b1d-94a7-43ae-8297-3ad04f1540b9",
    "provisioningState": "Succeeded",
    "jobState": "Created",
    "eventsOutOfOrderPolicy": "Drop",
    "outputErrorPolicy": "Drop",
    "eventsOutOfOrderMaxDelayInSeconds": 0,
    "eventsLateArrivalMaxDelayInSeconds": 5,
    "dataLocale": "en-US",
    "createdDate": "2017-05-11T04:37:11.54Z",
    "compatibilityLevel": "1.0",
    "inputs": [
      {
        "id": "/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourceGroups/sjrg3276/providers/Microsoft.StreamAnalytics/streamingjobs/sj7804/inputs/inputtest",
        "name": "inputtest",
        "type": "Microsoft.StreamAnalytics/streamingjobs/inputs",
        "properties": {
          "type": "Stream",
          "datasource": {
            "type": "Microsoft.Storage/Blob",
            "properties": {
              "storageAccounts": [
                {
                  "accountName": "accountName"
                }
              ],
              "container": "containerName",
              "pathPattern": ""
            }
          },
          "serialization": {
            "type": "Json",
            "properties": {
              "encoding": "UTF8"
            }
          },
          "etag": "ca88f8fa-605b-4c7f-8695-46f5faa60cd0"
        }
      }
    ],
    "transformation": {
      "id": "/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourceGroups/sjrg3276/providers/Microsoft.StreamAnalytics/streamingjobs/sj7804/transformations/transformationtest",
      "name": "transformationtest",
      "type": "Microsoft.StreamAnalytics/streamingjobs/transformations",
      "properties": {
        "streamingUnits": 1,
        "query": "Select Id, Name from inputtest",
        "etag": "91d8fcbe-60b3-49c3-9f21-9942b95602b8"
      }
    },
    "functions": [],
    "outputs": [
      {
        "id": "/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourceGroups/sjrg3276/providers/Microsoft.StreamAnalytics/streamingjobs/sj7804/outputs/outputtest",
        "name": "outputtest",
        "type": "Microsoft.StreamAnalytics/streamingjobs/outputs",
        "properties": {
          "datasource": {
            "type": "Microsoft.Sql/Server/Database",
            "properties": {
              "server": "serverName",
              "database": "databaseName",
              "table": "tableName",
              "user": "userName"
            }
          },
          "etag": "62097c3c-b503-41ff-a56f-196a9598ab90"
        }
      }
    ]
  }
}
ETag: 87551cc5-1290-4d08-afcd-cdaa92e5ade0
{
  "id": "/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourceGroups/sjrg3276/providers/Microsoft.StreamAnalytics/streamingjobs/sj7804",
  "name": "sj7804",
  "type": "Microsoft.StreamAnalytics/streamingjobs",
  "location": "West US",
  "tags": {
    "key1": "value1",
    "randomKey": "randomValue",
    "key3": "value3"
  },
  "properties": {
    "sku": {
      "name": "Standard"
    },
    "jobId": "732e4b1d-94a7-43ae-8297-3ad04f1540b9",
    "provisioningState": "Succeeded",
    "jobState": "Created",
    "eventsOutOfOrderPolicy": "Drop",
    "outputErrorPolicy": "Drop",
    "eventsOutOfOrderMaxDelayInSeconds": 0,
    "eventsLateArrivalMaxDelayInSeconds": 5,
    "dataLocale": "en-US",
    "createdDate": "2017-05-11T04:37:11.54Z",
    "compatibilityLevel": "1.0",
    "inputs": [
      {
        "id": "/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourceGroups/sjrg3276/providers/Microsoft.StreamAnalytics/streamingjobs/sj7804/inputs/inputtest",
        "name": "inputtest",
        "type": "Microsoft.StreamAnalytics/streamingjobs/inputs",
        "properties": {
          "type": "Stream",
          "datasource": {
            "type": "Microsoft.Storage/Blob",
            "properties": {
              "storageAccounts": [
                {
                  "accountName": "accountName"
                }
              ],
              "container": "containerName",
              "pathPattern": ""
            }
          },
          "serialization": {
            "type": "Json",
            "properties": {
              "encoding": "UTF8"
            }
          },
          "etag": "ca88f8fa-605b-4c7f-8695-46f5faa60cd0"
        }
      }
    ],
    "transformation": {
      "id": "/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourceGroups/sjrg3276/providers/Microsoft.StreamAnalytics/streamingjobs/sj7804/transformations/transformationtest",
      "name": "transformationtest",
      "type": "Microsoft.StreamAnalytics/streamingjobs/transformations",
      "properties": {
        "streamingUnits": 1,
        "query": "Select Id, Name from inputtest",
        "etag": "91d8fcbe-60b3-49c3-9f21-9942b95602b8"
      }
    },
    "functions": [],
    "outputs": [
      {
        "id": "/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourceGroups/sjrg3276/providers/Microsoft.StreamAnalytics/streamingjobs/sj7804/outputs/outputtest",
        "name": "outputtest",
        "type": "Microsoft.StreamAnalytics/streamingjobs/outputs",
        "properties": {
          "datasource": {
            "type": "Microsoft.Sql/Server/Database",
            "properties": {
              "server": "serverName",
              "database": "databaseName",
              "table": "tableName",
              "user": "userName"
            }
          },
          "etag": "62097c3c-b503-41ff-a56f-196a9598ab90"
        }
      }
    ]
  }
}

Create a streaming job shell (a streaming job with no inputs, outputs, transformation, or functions)

Sample request

PUT https://management.azure.com/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourcegroups/sjrg6936/providers/Microsoft.StreamAnalytics/streamingjobs/sj59?api-version=2020-03-01

{
  "properties": {
    "sku": {
      "name": "Standard"
    },
    "eventsOutOfOrderPolicy": "Drop",
    "outputErrorPolicy": "Drop",
    "eventsOutOfOrderMaxDelayInSeconds": 5,
    "eventsLateArrivalMaxDelayInSeconds": 16,
    "dataLocale": "en-US",
    "compatibilityLevel": "1.0",
    "inputs": [],
    "outputs": [],
    "functions": []
  },
  "location": "West US",
  "tags": {
    "key1": "value1",
    "randomKey": "randomValue",
    "key3": "value3"
  }
}

Sample response

ETag: 3e6872bc-c9d0-45b6-91b6-da66f1773056
{
  "id": "/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourceGroups/sjrg6936/providers/Microsoft.StreamAnalytics/streamingjobs/sj59",
  "name": "sj59",
  "type": "Microsoft.StreamAnalytics/streamingjobs",
  "location": "West US",
  "tags": {
    "key1": "value1",
    "randomKey": "randomValue",
    "key3": "value3"
  },
  "properties": {
    "sku": {
      "name": "Standard"
    },
    "jobId": "d53ecc3c-fcb0-485d-9caf-25e20fcb2061",
    "provisioningState": "Succeeded",
    "jobState": "Created",
    "eventsOutOfOrderPolicy": "Drop",
    "outputErrorPolicy": "Drop",
    "eventsOutOfOrderMaxDelayInSeconds": 5,
    "eventsLateArrivalMaxDelayInSeconds": 16,
    "dataLocale": "en-US",
    "createdDate": "2017-05-11T04:37:04.697Z",
    "compatibilityLevel": "1.0",
    "inputs": [],
    "functions": [],
    "outputs": []
  }
}
ETag: 3e6872bc-c9d0-45b6-91b6-da66f1773056
{
  "id": "/subscriptions/56b5e0a9-b645-407d-99b0-c64f86013e3d/resourceGroups/sjrg6936/providers/Microsoft.StreamAnalytics/streamingjobs/sj59",
  "name": "sj59",
  "type": "Microsoft.StreamAnalytics/streamingjobs",
  "location": "West US",
  "tags": {
    "key1": "value1",
    "randomKey": "randomValue",
    "key3": "value3"
  },
  "properties": {
    "sku": {
      "name": "Standard"
    },
    "jobId": "d53ecc3c-fcb0-485d-9caf-25e20fcb2061",
    "provisioningState": "Succeeded",
    "jobState": "Created",
    "eventsOutOfOrderPolicy": "Drop",
    "outputErrorPolicy": "Drop",
    "eventsOutOfOrderMaxDelayInSeconds": 5,
    "eventsLateArrivalMaxDelayInSeconds": 16,
    "dataLocale": "en-US",
    "createdDate": "2017-05-11T04:37:04.697Z",
    "compatibilityLevel": "1.0",
    "inputs": [],
    "functions": [],
    "outputs": []
  }
}

Definitions

Name Description
AggregateFunctionProperties

The properties that are associated with an aggregate function.

AuthenticationMode

Authentication Mode. Valid modes are ConnectionString, Msi and 'UserToken'.

AvroSerialization

Describes how data from an input is serialized or how data is serialized when written to an output in Avro format.

AzureDataLakeStoreOutputDataSource

Describes an Azure Data Lake Store output data source.

AzureFunctionOutputDataSource

Defines the metadata of AzureFunctionOutputDataSource

AzureMachineLearningWebServiceFunctionBinding

The binding to an Azure Machine Learning web service.

AzureMachineLearningWebServiceInputColumn

Describes an input column for the Azure Machine Learning web service endpoint.

AzureMachineLearningWebServiceInputs

The inputs for the Azure Machine Learning web service endpoint.

AzureMachineLearningWebServiceOutputColumn

Describes an output column for the Azure Machine Learning web service endpoint.

AzureSqlDatabaseOutputDataSource

Describes an Azure SQL database output data source.

AzureSqlReferenceInputDataSource

Describes an Azure SQL database reference input data source.

AzureSynapseOutputDataSource

Describes an Azure Synapse output data source.

AzureTableOutputDataSource

Describes an Azure Table output data source.

BlobOutputDataSource

Describes a blob output data source.

BlobReferenceInputDataSource

Describes a blob input data source that contains reference data.

BlobStreamInputDataSource

Describes a blob input data source that contains stream data.

ClusterInfo

The properties associated with a Stream Analytics cluster.

CompatibilityLevel

Controls certain runtime behaviors of the streaming job.

Compression

Describes how input data is compressed

CompressionType

Indicates the type of compression that the input uses. Required on PUT (CreateOrReplace) requests.

ContentStoragePolicy

Valid values are JobStorageAccount and SystemAccount. If set to JobStorageAccount, this requires the user to also specify jobStorageAccount property. .

CsvSerialization

Describes how data from an input is serialized or how data is serialized when written to an output in CSV format.

DiagnosticCondition

Condition applicable to the resource, or to the job overall, that warrant customer attention.

Diagnostics

Describes conditions applicable to the Input, Output, or the job overall, that warrant customer attention.

DocumentDbOutputDataSource

Describes a DocumentDB output data source.

Encoding

Specifies the encoding of the incoming data in the case of input and the encoding of outgoing data in the case of output.

Error

Common error representation.

EventHubOutputDataSource

Describes an Event Hub output data source.

EventHubStreamInputDataSource

Describes an Event Hub input data source that contains stream data.

EventHubV2OutputDataSource

Describes an Event Hub output data source.

EventHubV2StreamInputDataSource

Describes an Event Hub input data source that contains stream data.

EventSerializationType

Indicates the type of serialization that the input or output uses. Required on PUT (CreateOrReplace) requests.

EventsOutOfOrderPolicy

Indicates the policy to apply to events that arrive out of order in the input event stream.

FileReferenceInputDataSource

Describes a file input data source that contains reference data.

Function

A function object, containing all information associated with the named function. All functions are contained under a streaming job.

FunctionInput

Describes one input parameter of a function.

FunctionOutput

Describes the output of a function.

GatewayMessageBusOutputDataSource

Describes a Gateway Message Bus output data source.

GatewayMessageBusStreamInputDataSource

Describes a blob input data source that contains stream data.

Identity

Describes how identity is verified

Input

An input object, containing all information associated with the named input. All inputs are contained under a streaming job.

IoTHubStreamInputDataSource

Describes an IoT Hub input data source that contains stream data.

JavaScriptFunctionBinding

The binding to a JavaScript function.

JobStorageAccount

The properties that are associated with an Azure Storage account with MSI

JobType

Describes the type of the job. Valid modes are Cloud and 'Edge'.

JsonOutputSerializationFormat

Specifies the format of the JSON the output will be written in. The currently supported values are 'lineSeparated' indicating the output will be formatted by having each JSON object separated by a new line and 'array' indicating the output will be formatted as an array of JSON objects.

JsonSerialization

Describes how data from an input is serialized or how data is serialized when written to an output in JSON format.

Output

An output object, containing all information associated with the named output. All outputs are contained under a streaming job.

OutputErrorPolicy

Indicates the policy to apply to events that arrive at the output and cannot be written to the external storage due to being malformed (missing column values, column values of wrong type or size).

OutputStartMode

Value may be JobStartTime, CustomTime, or LastOutputEventTime to indicate whether the starting point of the output event stream should start whenever the job is started, start at a custom user time stamp specified via the outputStartTime property, or start from the last event output time.

ParquetSerialization

Describes how data from an input is serialized or how data is serialized when written to an output in Parquet format.

PowerBIOutputDataSource

Describes a Power BI output data source.

ReferenceInputProperties

The properties that are associated with an input containing reference data.

RefreshType

Indicates the type of data refresh option.

ScalarFunctionProperties

The properties that are associated with a scalar function.

ServiceBusQueueOutputDataSource

Describes a Service Bus Queue output data source.

ServiceBusTopicOutputDataSource

Describes a Service Bus Topic output data source.

Sku

The properties that are associated with a SKU.

SkuName

The name of the SKU. Required on PUT (CreateOrReplace) requests.

StorageAccount

The properties that are associated with an Azure Storage account

StreamingJob

A streaming job object, containing all information associated with the named streaming job.

StreamInputProperties

The properties that are associated with an input containing stream data.

Transformation

A transformation object, containing all information associated with the named transformation. All transformations are contained under a streaming job.

AggregateFunctionProperties

The properties that are associated with an aggregate function.

Name Type Description
etag

string

The current entity tag for the function. This is an opaque string. You can use it to detect whether the resource has changed between requests. You can also use it in the If-Match or If-None-Match headers for write operations for optimistic concurrency.

properties.binding FunctionBinding:

The physical binding of the function. For example, in the Azure Machine Learning web service’s case, this describes the endpoint.

properties.inputs

FunctionInput[]

Describes one input parameter of a function.

properties.output

FunctionOutput

Describes the output of a function.

type string:

Aggregate

Indicates the type of function.

AuthenticationMode

Authentication Mode. Valid modes are ConnectionString, Msi and 'UserToken'.

Name Type Description
ConnectionString

string

Msi

string

UserToken

string

AvroSerialization

Describes how data from an input is serialized or how data is serialized when written to an output in Avro format.

Name Type Description
type string:

Avro

Indicates the type of serialization that the input or output uses. Required on PUT (CreateOrReplace) requests.

AzureDataLakeStoreOutputDataSource

Describes an Azure Data Lake Store output data source.

Name Type Default value Description
properties.accountName

string

The name of the Azure Data Lake Store account. Required on PUT (CreateOrReplace) requests.

properties.authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.dateFormat

string

The date format. Wherever {date} appears in filePathPrefix, the value of this property is used as the date format instead.

properties.filePathPrefix

string

The location of the file to which the output should be written to. Required on PUT (CreateOrReplace) requests.

properties.refreshToken

string

A refresh token that can be used to obtain a valid access token that can then be used to authenticate with the data source. A valid refresh token is currently only obtainable via the Azure Portal. It is recommended to put a dummy string value here when creating the data source and then going to the Azure Portal to authenticate the data source which will update this property with a valid refresh token. Required on PUT (CreateOrReplace) requests.

properties.tenantId

string

The tenant id of the user used to obtain the refresh token. Required on PUT (CreateOrReplace) requests.

properties.timeFormat

string

The time format. Wherever {time} appears in filePathPrefix, the value of this property is used as the time format instead.

properties.tokenUserDisplayName

string

The user display name of the user that was used to obtain the refresh token. Use this property to help remember which user was used to obtain the refresh token.

properties.tokenUserPrincipalName

string

The user principal name (UPN) of the user that was used to obtain the refresh token. Use this property to help remember which user was used to obtain the refresh token.

type string:

Microsoft.DataLake/Accounts

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

AzureFunctionOutputDataSource

Defines the metadata of AzureFunctionOutputDataSource

Name Type Description
properties.apiKey

string

If you want to use an Azure Function from another subscription, you can do so by providing the key to access your function.

properties.functionAppName

string

The name of your Azure Functions app.

properties.functionName

string

The name of the function in your Azure Functions app.

properties.maxBatchCount

number

A property that lets you specify the maximum number of events in each batch that's sent to Azure Functions. The default value is 100.

properties.maxBatchSize

number

A property that lets you set the maximum size for each output batch that's sent to your Azure function. The input unit is in bytes. By default, this value is 262,144 bytes (256 KB).

type string:

Microsoft.AzureFunction

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

AzureMachineLearningWebServiceFunctionBinding

The binding to an Azure Machine Learning web service.

Name Type Description
properties.apiKey

string

The API key used to authenticate with Request-Response endpoint.

properties.batchSize

integer

Number between 1 and 10000 describing maximum number of rows for every Azure ML RRS execute request. Default is 1000.

properties.endpoint

string

The Request-Response execute endpoint of the Azure Machine Learning web service. Find out more here: https://docs.microsoft.com/en-us/azure/machine-learning/machine-learning-consume-web-services#request-response-service-rrs

properties.inputs

AzureMachineLearningWebServiceInputs

The inputs for the Azure Machine Learning web service endpoint.

properties.outputs

AzureMachineLearningWebServiceOutputColumn[]

A list of outputs from the Azure Machine Learning web service endpoint execution.

type string:

Microsoft.MachineLearning/WebService

Indicates the function binding type.

AzureMachineLearningWebServiceInputColumn

Describes an input column for the Azure Machine Learning web service endpoint.

Name Type Description
dataType

string

The (Azure Machine Learning supported) data type of the input column. A list of valid Azure Machine Learning data types are described at https://msdn.microsoft.com/en-us/library/azure/dn905923.aspx .

mapTo

integer

The zero based index of the function parameter this input maps to.

name

string

The name of the input column.

AzureMachineLearningWebServiceInputs

The inputs for the Azure Machine Learning web service endpoint.

Name Type Description
columnNames

AzureMachineLearningWebServiceInputColumn[]

A list of input columns for the Azure Machine Learning web service endpoint.

name

string

The name of the input. This is the name provided while authoring the endpoint.

AzureMachineLearningWebServiceOutputColumn

Describes an output column for the Azure Machine Learning web service endpoint.

Name Type Description
dataType

string

The (Azure Machine Learning supported) data type of the output column. A list of valid Azure Machine Learning data types are described at https://msdn.microsoft.com/en-us/library/azure/dn905923.aspx .

name

string

The name of the output column.

AzureSqlDatabaseOutputDataSource

Describes an Azure SQL database output data source.

Name Type Default value Description
properties.authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.database

string

The name of the Azure SQL database. Required on PUT (CreateOrReplace) requests.

properties.maxBatchCount

number

Max Batch count for write to Sql database, the default value is 10,000. Optional on PUT requests.

properties.maxWriterCount

number

Max Writer count, currently only 1(single writer) and 0(based on query partition) are available. Optional on PUT requests.

properties.password

string

The password that will be used to connect to the Azure SQL database. Required on PUT (CreateOrReplace) requests.

properties.server

string

The name of the SQL server containing the Azure SQL database. Required on PUT (CreateOrReplace) requests.

properties.table

string

The name of the table in the Azure SQL database. Required on PUT (CreateOrReplace) requests.

properties.user

string

The user name that will be used to connect to the Azure SQL database. Required on PUT (CreateOrReplace) requests.

type string:

Microsoft.Sql/Server/Database

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

AzureSqlReferenceInputDataSource

Describes an Azure SQL database reference input data source.

Name Type Description
properties.database

string

This element is associated with the datasource element. This is the name of the database that output will be written to.

properties.deltaSnapshotQuery

string

This element is associated with the datasource element. This query is used to fetch incremental changes from the SQL database. To use this option, we recommend using temporal tables in Azure SQL Database.

properties.fullSnapshotQuery

string

This element is associated with the datasource element. This query is used to fetch data from the sql database.

properties.password

string

This element is associated with the datasource element. This is the password that will be used to connect to the SQL Database instance.

properties.refreshRate

string

This element is associated with the datasource element. This indicates how frequently the data will be fetched from the database. It is of DateTime format.

properties.refreshType

RefreshType

Indicates the type of data refresh option.

properties.server

string

This element is associated with the datasource element. This is the name of the server that contains the database that will be written to.

properties.table

string

This element is associated with the datasource element. The name of the table in the Azure SQL database..

properties.user

string

This element is associated with the datasource element. This is the user name that will be used to connect to the SQL Database instance.

type string:

Microsoft.Sql/Server/Database

Indicates the type of input data source containing reference data. Required on PUT (CreateOrReplace) requests.

AzureSynapseOutputDataSource

Describes an Azure Synapse output data source.

Name Type Description
properties.database

string

The name of the Azure SQL database. Required on PUT (CreateOrReplace) requests.

properties.password

string

The password that will be used to connect to the Azure SQL database. Required on PUT (CreateOrReplace) requests.

properties.server

string

The name of the SQL server containing the Azure SQL database. Required on PUT (CreateOrReplace) requests.

properties.table

string

The name of the table in the Azure SQL database. Required on PUT (CreateOrReplace) requests.

properties.user

string

The user name that will be used to connect to the Azure SQL database. Required on PUT (CreateOrReplace) requests.

type string:

Microsoft.Sql/Server/DataWarehouse

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

AzureTableOutputDataSource

Describes an Azure Table output data source.

Name Type Description
properties.accountKey

string

The account key for the Azure Storage account. Required on PUT (CreateOrReplace) requests.

properties.accountName

string

The name of the Azure Storage account. Required on PUT (CreateOrReplace) requests.

properties.batchSize

integer

The number of rows to write to the Azure Table at a time.

properties.columnsToRemove

string[]

If specified, each item in the array is the name of a column to remove (if present) from output event entities.

properties.partitionKey

string

This element indicates the name of a column from the SELECT statement in the query that will be used as the partition key for the Azure Table. Required on PUT (CreateOrReplace) requests.

properties.rowKey

string

This element indicates the name of a column from the SELECT statement in the query that will be used as the row key for the Azure Table. Required on PUT (CreateOrReplace) requests.

properties.table

string

The name of the Azure Table. Required on PUT (CreateOrReplace) requests.

type string:

Microsoft.Storage/Table

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

BlobOutputDataSource

Describes a blob output data source.

Name Type Default value Description
properties.authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.blobPathPrefix

string

Blob path prefix.

properties.container

string

The name of a container within the associated Storage account. This container contains either the blob(s) to be read from or written to. Required on PUT (CreateOrReplace) requests.

properties.dateFormat

string

The date format. Wherever {date} appears in pathPattern, the value of this property is used as the date format instead.

properties.pathPattern

string

The blob path pattern. Not a regular expression. It represents a pattern against which blob names will be matched to determine whether or not they should be included as input or output to the job. See https://docs.microsoft.com/en-us/rest/api/streamanalytics/stream-analytics-input or https://docs.microsoft.com/en-us/rest/api/streamanalytics/stream-analytics-output for a more detailed explanation and example.

properties.storageAccounts

StorageAccount[]

A list of one or more Azure Storage accounts. Required on PUT (CreateOrReplace) requests.

properties.timeFormat

string

The time format. Wherever {time} appears in pathPattern, the value of this property is used as the time format instead.

type string:

Microsoft.Storage/Blob

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

BlobReferenceInputDataSource

Describes a blob input data source that contains reference data.

Name Type Default value Description
properties.authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.container

string

The name of a container within the associated Storage account. This container contains either the blob(s) to be read from or written to. Required on PUT (CreateOrReplace) requests.

properties.dateFormat

string

The date format. Wherever {date} appears in pathPattern, the value of this property is used as the date format instead.

properties.pathPattern

string

The blob path pattern. Not a regular expression. It represents a pattern against which blob names will be matched to determine whether or not they should be included as input or output to the job. See https://docs.microsoft.com/en-us/rest/api/streamanalytics/stream-analytics-input or https://docs.microsoft.com/en-us/rest/api/streamanalytics/stream-analytics-output for a more detailed explanation and example.

properties.storageAccounts

StorageAccount[]

A list of one or more Azure Storage accounts. Required on PUT (CreateOrReplace) requests.

properties.timeFormat

string

The time format. Wherever {time} appears in pathPattern, the value of this property is used as the time format instead.

type string:

Microsoft.Storage/Blob

Indicates the type of input data source containing reference data. Required on PUT (CreateOrReplace) requests.

BlobStreamInputDataSource

Describes a blob input data source that contains stream data.

Name Type Default value Description
properties.authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.container

string

The name of a container within the associated Storage account. This container contains either the blob(s) to be read from or written to. Required on PUT (CreateOrReplace) requests.

properties.dateFormat

string

The date format. Wherever {date} appears in pathPattern, the value of this property is used as the date format instead.

properties.pathPattern

string

The blob path pattern. Not a regular expression. It represents a pattern against which blob names will be matched to determine whether or not they should be included as input or output to the job. See https://docs.microsoft.com/en-us/rest/api/streamanalytics/stream-analytics-input or https://docs.microsoft.com/en-us/rest/api/streamanalytics/stream-analytics-output for a more detailed explanation and example.

properties.sourcePartitionCount

integer

The partition count of the blob input data source. Range 1 - 1024.

properties.storageAccounts

StorageAccount[]

A list of one or more Azure Storage accounts. Required on PUT (CreateOrReplace) requests.

properties.timeFormat

string

The time format. Wherever {time} appears in pathPattern, the value of this property is used as the time format instead.

type string:

Microsoft.Storage/Blob

Indicates the type of input data source containing stream data. Required on PUT (CreateOrReplace) requests.

ClusterInfo

The properties associated with a Stream Analytics cluster.

Name Type Description
id

string

The resource id of cluster.

CompatibilityLevel

Controls certain runtime behaviors of the streaming job.

Name Type Description
1.0

string

1.2

string

Compression

Describes how input data is compressed

Name Type Default value Description
type

CompressionType

None

Indicates the type of compression that the input uses. Required on PUT (CreateOrReplace) requests.

CompressionType

Indicates the type of compression that the input uses. Required on PUT (CreateOrReplace) requests.

Name Type Description
Deflate

string

GZip

string

None

string

ContentStoragePolicy

Valid values are JobStorageAccount and SystemAccount. If set to JobStorageAccount, this requires the user to also specify jobStorageAccount property. .

Name Type Description
JobStorageAccount

string

SystemAccount

string

CsvSerialization

Describes how data from an input is serialized or how data is serialized when written to an output in CSV format.

Name Type Description
properties.encoding

Encoding

Specifies the encoding of the incoming data in the case of input and the encoding of outgoing data in the case of output. Required on PUT (CreateOrReplace) requests.

properties.fieldDelimiter

string

Specifies the delimiter that will be used to separate comma-separated value (CSV) records. See https://docs.microsoft.com/en-us/rest/api/streamanalytics/stream-analytics-input or https://docs.microsoft.com/en-us/rest/api/streamanalytics/stream-analytics-output for a list of supported values. Required on PUT (CreateOrReplace) requests.

type string:

Csv

Indicates the type of serialization that the input or output uses. Required on PUT (CreateOrReplace) requests.

DiagnosticCondition

Condition applicable to the resource, or to the job overall, that warrant customer attention.

Name Type Description
code

string

The opaque diagnostic code.

message

string

The human-readable message describing the condition in detail. Localized in the Accept-Language of the client request.

since

string

The UTC timestamp of when the condition started. Customers should be able to find a corresponding event in the ops log around this time.

Diagnostics

Describes conditions applicable to the Input, Output, or the job overall, that warrant customer attention.

Name Type Description
conditions

DiagnosticCondition[]

A collection of zero or more conditions applicable to the resource, or to the job overall, that warrant customer attention.

DocumentDbOutputDataSource

Describes a DocumentDB output data source.

Name Type Description
properties.accountId

string

The DocumentDB account name or ID. Required on PUT (CreateOrReplace) requests.

properties.accountKey

string

The account key for the DocumentDB account. Required on PUT (CreateOrReplace) requests.

properties.collectionNamePattern

string

The collection name pattern for the collections to be used. The collection name format can be constructed using the optional {partition} token, where partitions start from 0. See the DocumentDB section of https://docs.microsoft.com/en-us/rest/api/streamanalytics/stream-analytics-output for more information. Required on PUT (CreateOrReplace) requests.

properties.database

string

The name of the DocumentDB database. Required on PUT (CreateOrReplace) requests.

properties.documentId

string

The name of the field in output events used to specify the primary key which insert or update operations are based on.

properties.partitionKey

string

The name of the field in output events used to specify the key for partitioning output across collections. If 'collectionNamePattern' contains the {partition} token, this property is required to be specified.

type string:

Microsoft.Storage/DocumentDB

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

Encoding

Specifies the encoding of the incoming data in the case of input and the encoding of outgoing data in the case of output.

Name Type Description
UTF8

string

Error

Common error representation.

Name Type Description
error

Error

Error definition properties.

EventHubOutputDataSource

Describes an Event Hub output data source.

Name Type Default value Description
authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.eventHubName

string

The name of the Event Hub. Required on PUT (CreateOrReplace) requests.

properties.partitionKey

string

The key/column that is used to determine to which partition to send event data.

properties.propertyColumns

string[]

The properties associated with this Event Hub output.

serviceBusNamespace

string

The namespace that is associated with the desired Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

sharedAccessPolicyKey

string

The shared access policy key for the specified shared access policy. Required on PUT (CreateOrReplace) requests.

sharedAccessPolicyName

string

The shared access policy name for the Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

type string:

Microsoft.ServiceBus/EventHub

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

EventHubStreamInputDataSource

Describes an Event Hub input data source that contains stream data.

Name Type Default value Description
authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.consumerGroupName

string

The name of an Event Hub Consumer Group that should be used to read events from the Event Hub. Specifying distinct consumer group names for multiple inputs allows each of those inputs to receive the same events from the Event Hub. If not specified, the input uses the Event Hub’s default consumer group.

properties.eventHubName

string

The name of the Event Hub. Required on PUT (CreateOrReplace) requests.

serviceBusNamespace

string

The namespace that is associated with the desired Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

sharedAccessPolicyKey

string

The shared access policy key for the specified shared access policy. Required on PUT (CreateOrReplace) requests.

sharedAccessPolicyName

string

The shared access policy name for the Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

type string:

Microsoft.ServiceBus/EventHub

Indicates the type of input data source containing stream data. Required on PUT (CreateOrReplace) requests.

EventHubV2OutputDataSource

Describes an Event Hub output data source.

Name Type Default value Description
authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.eventHubName

string

The name of the Event Hub. Required on PUT (CreateOrReplace) requests.

properties.partitionKey

string

The key/column that is used to determine to which partition to send event data.

properties.propertyColumns

string[]

The properties associated with this Event Hub output.

serviceBusNamespace

string

The namespace that is associated with the desired Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

sharedAccessPolicyKey

string

The shared access policy key for the specified shared access policy. Required on PUT (CreateOrReplace) requests.

sharedAccessPolicyName

string

The shared access policy name for the Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

type string:

Microsoft.EventHub/EventHub

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

EventHubV2StreamInputDataSource

Describes an Event Hub input data source that contains stream data.

Name Type Default value Description
authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.consumerGroupName

string

The name of an Event Hub Consumer Group that should be used to read events from the Event Hub. Specifying distinct consumer group names for multiple inputs allows each of those inputs to receive the same events from the Event Hub. If not specified, the input uses the Event Hub’s default consumer group.

properties.eventHubName

string

The name of the Event Hub. Required on PUT (CreateOrReplace) requests.

serviceBusNamespace

string

The namespace that is associated with the desired Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

sharedAccessPolicyKey

string

The shared access policy key for the specified shared access policy. Required on PUT (CreateOrReplace) requests.

sharedAccessPolicyName

string

The shared access policy name for the Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

type string:

Microsoft.EventHub/EventHub

Indicates the type of input data source containing stream data. Required on PUT (CreateOrReplace) requests.

EventSerializationType

Indicates the type of serialization that the input or output uses. Required on PUT (CreateOrReplace) requests.

Name Type Description
Avro

string

Csv

string

Json

string

Parquet

string

EventsOutOfOrderPolicy

Indicates the policy to apply to events that arrive out of order in the input event stream.

Name Type Description
Adjust

string

Drop

string

FileReferenceInputDataSource

Describes a file input data source that contains reference data.

Name Type Description
properties.path

string

The path of the file.

type string:

File

Indicates the type of input data source containing reference data. Required on PUT (CreateOrReplace) requests.

Function

A function object, containing all information associated with the named function. All functions are contained under a streaming job.

Name Type Description
id

string

Resource Id

name

string

Resource name

properties FunctionProperties:

The properties that are associated with a function.

type

string

Resource type

FunctionInput

Describes one input parameter of a function.

Name Type Description
dataType

string

The (Azure Stream Analytics supported) data type of the function input parameter. A list of valid Azure Stream Analytics data types are described at https://msdn.microsoft.com/en-us/library/azure/dn835065.aspx

isConfigurationParameter

boolean

A flag indicating if the parameter is a configuration parameter. True if this input parameter is expected to be a constant. Default is false.

FunctionOutput

Describes the output of a function.

Name Type Description
dataType

string

The (Azure Stream Analytics supported) data type of the function output. A list of valid Azure Stream Analytics data types are described at https://msdn.microsoft.com/en-us/library/azure/dn835065.aspx

GatewayMessageBusOutputDataSource

Describes a Gateway Message Bus output data source.

Name Type Description
properties.topic

string

The name of the Service Bus topic.

type string:

GatewayMessageBus

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

GatewayMessageBusStreamInputDataSource

Describes a blob input data source that contains stream data.

Name Type Description
properties.topic

string

The name of the Service Bus topic.

type string:

GatewayMessageBus

Indicates the type of input data source containing stream data. Required on PUT (CreateOrReplace) requests.

Identity

Describes how identity is verified

Name Type Description
principalId

string

The identity principal ID

tenantId

string

The identity tenantId

type

string

The identity type

Input

An input object, containing all information associated with the named input. All inputs are contained under a streaming job.

Name Type Description
id

string

Resource Id

name

string

Resource name

properties InputProperties:

The properties that are associated with an input. Required on PUT (CreateOrReplace) requests.

type

string

Resource type

IoTHubStreamInputDataSource

Describes an IoT Hub input data source that contains stream data.

Name Type Description
properties.consumerGroupName

string

The name of an IoT Hub Consumer Group that should be used to read events from the IoT Hub. If not specified, the input uses the Iot Hub’s default consumer group.

properties.endpoint

string

The IoT Hub endpoint to connect to (ie. messages/events, messages/operationsMonitoringEvents, etc.).

properties.iotHubNamespace

string

The name or the URI of the IoT Hub. Required on PUT (CreateOrReplace) requests.

properties.sharedAccessPolicyKey

string

The shared access policy key for the specified shared access policy. Required on PUT (CreateOrReplace) requests.

properties.sharedAccessPolicyName

string

The shared access policy name for the IoT Hub. This policy must contain at least the Service connect permission. Required on PUT (CreateOrReplace) requests.

type string:

Microsoft.Devices/IotHubs

Indicates the type of input data source containing stream data. Required on PUT (CreateOrReplace) requests.

JavaScriptFunctionBinding

The binding to a JavaScript function.

Name Type Description
properties.script

string

The JavaScript code containing a single function definition. For example: 'function (x, y) { return x + y; }'

type string:

Microsoft.StreamAnalytics/JavascriptUdf

Indicates the function binding type.

JobStorageAccount

The properties that are associated with an Azure Storage account with MSI

Name Type Default value Description
accountKey

string

The account key for the Azure Storage account. Required on PUT (CreateOrReplace) requests.

accountName

string

The name of the Azure Storage account. Required on PUT (CreateOrReplace) requests.

authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

JobType

Describes the type of the job. Valid modes are Cloud and 'Edge'.

Name Type Description
Cloud

string

Edge

string

JsonOutputSerializationFormat

Specifies the format of the JSON the output will be written in. The currently supported values are 'lineSeparated' indicating the output will be formatted by having each JSON object separated by a new line and 'array' indicating the output will be formatted as an array of JSON objects.

Name Type Description
Array

string

LineSeparated

string

JsonSerialization

Describes how data from an input is serialized or how data is serialized when written to an output in JSON format.

Name Type Description
properties.encoding

Encoding

Specifies the encoding of the incoming data in the case of input and the encoding of outgoing data in the case of output. Required on PUT (CreateOrReplace) requests.

properties.format

JsonOutputSerializationFormat

This property only applies to JSON serialization of outputs only. It is not applicable to inputs. This property specifies the format of the JSON the output will be written in. The currently supported values are 'lineSeparated' indicating the output will be formatted by having each JSON object separated by a new line and 'array' indicating the output will be formatted as an array of JSON objects. Default value is 'lineSeparated' if left null.

type string:

Json

Indicates the type of serialization that the input or output uses. Required on PUT (CreateOrReplace) requests.

Output

An output object, containing all information associated with the named output. All outputs are contained under a streaming job.

Name Type Description
id

string

Resource Id

name

string

Resource name

properties.datasource OutputDataSource:

Describes the data source that output will be written to. Required on PUT (CreateOrReplace) requests.

properties.diagnostics

Diagnostics

Describes conditions applicable to the Input, Output, or the job overall, that warrant customer attention.

properties.etag

string

The current entity tag for the output. This is an opaque string. You can use it to detect whether the resource has changed between requests. You can also use it in the If-Match or If-None-Match headers for write operations for optimistic concurrency.

properties.serialization Serialization:

Describes how data from an input is serialized or how data is serialized when written to an output. Required on PUT (CreateOrReplace) requests.

properties.sizeWindow

integer

The size window to constrain a Stream Analytics output to.

properties.timeWindow

string

The time frame for filtering Stream Analytics job outputs.

type

string

Resource type

OutputErrorPolicy

Indicates the policy to apply to events that arrive at the output and cannot be written to the external storage due to being malformed (missing column values, column values of wrong type or size).

Name Type Description
Drop

string

Stop

string

OutputStartMode

Value may be JobStartTime, CustomTime, or LastOutputEventTime to indicate whether the starting point of the output event stream should start whenever the job is started, start at a custom user time stamp specified via the outputStartTime property, or start from the last event output time.

Name Type Description
CustomTime

string

JobStartTime

string

LastOutputEventTime

string

ParquetSerialization

Describes how data from an input is serialized or how data is serialized when written to an output in Parquet format.

Name Type Description
type string:

Parquet

Indicates the type of serialization that the input or output uses. Required on PUT (CreateOrReplace) requests.

PowerBIOutputDataSource

Describes a Power BI output data source.

Name Type Default value Description
properties.authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.dataset

string

The name of the Power BI dataset. Required on PUT (CreateOrReplace) requests.

properties.groupId

string

The ID of the Power BI group.

properties.groupName

string

The name of the Power BI group. Use this property to help remember which specific Power BI group id was used.

properties.refreshToken

string

A refresh token that can be used to obtain a valid access token that can then be used to authenticate with the data source. A valid refresh token is currently only obtainable via the Azure Portal. It is recommended to put a dummy string value here when creating the data source and then going to the Azure Portal to authenticate the data source which will update this property with a valid refresh token. Required on PUT (CreateOrReplace) requests.

properties.table

string

The name of the Power BI table under the specified dataset. Required on PUT (CreateOrReplace) requests.

properties.tokenUserDisplayName

string

The user display name of the user that was used to obtain the refresh token. Use this property to help remember which user was used to obtain the refresh token.

properties.tokenUserPrincipalName

string

The user principal name (UPN) of the user that was used to obtain the refresh token. Use this property to help remember which user was used to obtain the refresh token.

type string:

PowerBI

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

ReferenceInputProperties

The properties that are associated with an input containing reference data.

Name Type Description
compression

Compression

Describes how input data is compressed

datasource ReferenceInputDataSource:

Describes an input data source that contains reference data. Required on PUT (CreateOrReplace) requests.

diagnostics

Diagnostics

Describes conditions applicable to the Input, Output, or the job overall, that warrant customer attention.

etag

string

The current entity tag for the input. This is an opaque string. You can use it to detect whether the resource has changed between requests. You can also use it in the If-Match or If-None-Match headers for write operations for optimistic concurrency.

partitionKey

string

partitionKey Describes a key in the input data which is used for partitioning the input data

serialization Serialization:

Describes how data from an input is serialized or how data is serialized when written to an output. Required on PUT (CreateOrReplace) requests.

type string:

Reference

Indicates whether the input is a source of reference data or stream data. Required on PUT (CreateOrReplace) requests.

RefreshType

Indicates the type of data refresh option.

Name Type Description
RefreshPeriodicallyWithDelta

string

RefreshPeriodicallyWithFull

string

Static

string

ScalarFunctionProperties

The properties that are associated with a scalar function.

Name Type Description
etag

string

The current entity tag for the function. This is an opaque string. You can use it to detect whether the resource has changed between requests. You can also use it in the If-Match or If-None-Match headers for write operations for optimistic concurrency.

properties.binding FunctionBinding:

The physical binding of the function. For example, in the Azure Machine Learning web service’s case, this describes the endpoint.

properties.inputs

FunctionInput[]

Describes one input parameter of a function.

properties.output

FunctionOutput

Describes the output of a function.

type string:

Scalar

Indicates the type of function.

ServiceBusQueueOutputDataSource

Describes a Service Bus Queue output data source.

Name Type Default value Description
properties.authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.propertyColumns

string[]

A string array of the names of output columns to be attached to Service Bus messages as custom properties.

properties.queueName

string

The name of the Service Bus Queue. Required on PUT (CreateOrReplace) requests.

properties.serviceBusNamespace

string

The namespace that is associated with the desired Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

properties.sharedAccessPolicyKey

string

The shared access policy key for the specified shared access policy. Required on PUT (CreateOrReplace) requests.

properties.sharedAccessPolicyName

string

The shared access policy name for the Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

properties.systemPropertyColumns

object

The system properties associated with the Service Bus Queue. The following system properties are supported: ReplyToSessionId, ContentType, To, Subject, CorrelationId, TimeToLive, PartitionKey, SessionId, ScheduledEnqueueTime, MessageId, ReplyTo, Label, ScheduledEnqueueTimeUtc.

type string:

Microsoft.ServiceBus/Queue

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

ServiceBusTopicOutputDataSource

Describes a Service Bus Topic output data source.

Name Type Default value Description
properties.authenticationMode

AuthenticationMode

ConnectionString

Authentication Mode.

properties.propertyColumns

string[]

A string array of the names of output columns to be attached to Service Bus messages as custom properties.

properties.serviceBusNamespace

string

The namespace that is associated with the desired Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

properties.sharedAccessPolicyKey

string

The shared access policy key for the specified shared access policy. Required on PUT (CreateOrReplace) requests.

properties.sharedAccessPolicyName

string

The shared access policy name for the Event Hub, Service Bus Queue, Service Bus Topic, etc. Required on PUT (CreateOrReplace) requests.

properties.systemPropertyColumns

object

The system properties associated with the Service Bus Topic Output. The following system properties are supported: ReplyToSessionId, ContentType, To, Subject, CorrelationId, TimeToLive, PartitionKey, SessionId, ScheduledEnqueueTime, MessageId, ReplyTo, Label, ScheduledEnqueueTimeUtc.

properties.topicName

string

The name of the Service Bus Topic. Required on PUT (CreateOrReplace) requests.

type string:

Microsoft.ServiceBus/Topic

Indicates the type of data source output will be written to. Required on PUT (CreateOrReplace) requests.

Sku

The properties that are associated with a SKU.

Name Type Description
name

SkuName

The name of the SKU. Required on PUT (CreateOrReplace) requests.

SkuName

The name of the SKU. Required on PUT (CreateOrReplace) requests.

Name Type Description
Standard

string

StorageAccount

The properties that are associated with an Azure Storage account

Name Type Description
accountKey

string

The account key for the Azure Storage account. Required on PUT (CreateOrReplace) requests.

accountName

string

The name of the Azure Storage account. Required on PUT (CreateOrReplace) requests.

StreamingJob

A streaming job object, containing all information associated with the named streaming job.

Name Type Description
id

string

Fully qualified resource Id for the resource. Ex - /subscriptions/{subscriptionId}/resourceGroups/{resourceGroupName}/providers/{resourceProviderNamespace}/{resourceType}/{resourceName}

identity

Identity

Describes the system-assigned managed identity assigned to this job that can be used to authenticate with inputs and outputs.

location

string

The geo-location where the resource lives

name

string

The name of the resource

properties.cluster

ClusterInfo

The cluster which streaming jobs will run on.

properties.compatibilityLevel

CompatibilityLevel

Controls certain runtime behaviors of the streaming job.

properties.contentStoragePolicy

ContentStoragePolicy

Valid values are JobStorageAccount and SystemAccount. If set to JobStorageAccount, this requires the user to also specify jobStorageAccount property. .

properties.createdDate

string

Value is an ISO-8601 formatted UTC timestamp indicating when the streaming job was created.

properties.dataLocale

string

The data locale of the stream analytics job. Value should be the name of a supported .NET Culture from the set https://msdn.microsoft.com/en-us/library/system.globalization.culturetypes(v=vs.110).aspx. Defaults to 'en-US' if none specified.

properties.etag

string

The current entity tag for the streaming job. This is an opaque string. You can use it to detect whether the resource has changed between requests. You can also use it in the If-Match or If-None-Match headers for write operations for optimistic concurrency.

properties.eventsLateArrivalMaxDelayInSeconds

integer

The maximum tolerable delay in seconds where events arriving late could be included. Supported range is -1 to 1814399 (20.23:59:59 days) and -1 is used to specify wait indefinitely. If the property is absent, it is interpreted to have a value of -1.

properties.eventsOutOfOrderMaxDelayInSeconds

integer

The maximum tolerable delay in seconds where out-of-order events can be adjusted to be back in order.

properties.eventsOutOfOrderPolicy

EventsOutOfOrderPolicy

Indicates the policy to apply to events that arrive out of order in the input event stream.

properties.functions

Function[]

A list of one or more functions for the streaming job. The name property for each function is required when specifying this property in a PUT request. This property cannot be modify via a PATCH operation. You must use the PATCH API available for the individual transformation.

properties.inputs

Input[]

A list of one or more inputs to the streaming job. The name property for each input is required when specifying this property in a PUT request. This property cannot be modify via a PATCH operation. You must use the PATCH API available for the individual input.

properties.jobId

string

A GUID uniquely identifying the streaming job. This GUID is generated upon creation of the streaming job.

properties.jobState

string

Describes the state of the streaming job.

properties.jobStorageAccount

JobStorageAccount

The properties that are associated with an Azure Storage account with MSI

properties.jobType

JobType

Describes the type of the job. Valid modes are Cloud and 'Edge'.

properties.lastOutputEventTime

string

Value is either an ISO-8601 formatted timestamp indicating the last output event time of the streaming job or null indicating that output has not yet been produced. In case of multiple outputs or multiple streams, this shows the latest value in that set.

properties.outputErrorPolicy

OutputErrorPolicy

Indicates the policy to apply to events that arrive at the output and cannot be written to the external storage due to being malformed (missing column values, column values of wrong type or size).

properties.outputStartMode

OutputStartMode

This property should only be utilized when it is desired that the job be started immediately upon creation. Value may be JobStartTime, CustomTime, or LastOutputEventTime to indicate whether the starting point of the output event stream should start whenever the job is started, start at a custom user time stamp specified via the outputStartTime property, or start from the last event output time.

properties.outputStartTime

string

Value is either an ISO-8601 formatted time stamp that indicates the starting point of the output event stream, or null to indicate that the output event stream will start whenever the streaming job is started. This property must have a value if outputStartMode is set to CustomTime.

properties.outputs

Output[]

A list of one or more outputs for the streaming job. The name property for each output is required when specifying this property in a PUT request. This property cannot be modify via a PATCH operation. You must use the PATCH API available for the individual output.

properties.provisioningState

string

Describes the provisioning status of the streaming job.

properties.sku

Sku

Describes the SKU of the streaming job. Required on PUT (CreateOrReplace) requests.

properties.transformation

Transformation

Indicates the query and the number of streaming units to use for the streaming job. The name property of the transformation is required when specifying this property in a PUT request. This property cannot be modify via a PATCH operation. You must use the PATCH API available for the individual transformation.

tags

object

Resource tags.

type

string

The type of the resource. Ex- Microsoft.Compute/virtualMachines or Microsoft.Storage/storageAccounts.

StreamInputProperties

The properties that are associated with an input containing stream data.

Name Type Description
compression

Compression

Describes how input data is compressed

datasource StreamInputDataSource:

Describes an input data source that contains stream data. Required on PUT (CreateOrReplace) requests.

diagnostics

Diagnostics

Describes conditions applicable to the Input, Output, or the job overall, that warrant customer attention.

etag

string

The current entity tag for the input. This is an opaque string. You can use it to detect whether the resource has changed between requests. You can also use it in the If-Match or If-None-Match headers for write operations for optimistic concurrency.

partitionKey

string

partitionKey Describes a key in the input data which is used for partitioning the input data

serialization Serialization:

Describes how data from an input is serialized or how data is serialized when written to an output. Required on PUT (CreateOrReplace) requests.

type string:

Stream

Indicates whether the input is a source of reference data or stream data. Required on PUT (CreateOrReplace) requests.

Transformation

A transformation object, containing all information associated with the named transformation. All transformations are contained under a streaming job.

Name Type Default value Description
id

string

Resource Id

name

string

Resource name

properties.etag

string

The current entity tag for the transformation. This is an opaque string. You can use it to detect whether the resource has changed between requests. You can also use it in the If-Match or If-None-Match headers for write operations for optimistic concurrency.

properties.query

string

Specifies the query that will be run in the streaming job. You can learn more about the Stream Analytics Query Language (SAQL) here: https://msdn.microsoft.com/library/azure/dn834998 . Required on PUT (CreateOrReplace) requests.

properties.streamingUnits

integer

3

Specifies the number of streaming units that the streaming job uses.

properties.validStreamingUnits

integer[]

Specifies the valid streaming units a streaming job can scale to.

type

string

Resource type