AzureDatabricksLinkedService Class

Definition

Azure Databricks linked service.

[Microsoft.Rest.Serialization.JsonTransformation]
[Newtonsoft.Json.JsonObject("AzureDatabricks")]
public class AzureDatabricksLinkedService : Microsoft.Azure.Management.DataFactory.Models.LinkedService
[<Microsoft.Rest.Serialization.JsonTransformation>]
[<Newtonsoft.Json.JsonObject("AzureDatabricks")>]
type AzureDatabricksLinkedService = class
    inherit LinkedService
Public Class AzureDatabricksLinkedService
Inherits LinkedService
Inheritance
AzureDatabricksLinkedService
Attributes
JsonTransformationAttribute Newtonsoft.Json.JsonObjectAttribute

Constructors

AzureDatabricksLinkedService()

Initializes a new instance of the AzureDatabricksLinkedService class.

AzureDatabricksLinkedService(Object, IDictionary<String,Object>, IntegrationRuntimeReference, String, IDictionary<String,ParameterSpecification>, IList<Object>, SecretBase, Object, Object, Object, Object, Object, Object, Object, IDictionary<String,Object>, IDictionary<String, Object>, IDictionary<String,Object>, Object, Object, Object, Object, Object, Object, CredentialReference)

Initializes a new instance of the AzureDatabricksLinkedService class.

Properties

AccessToken

Gets or sets access token for databricks REST API. Refer to https://docs.azuredatabricks.net/api/latest/authentication.html. Type: string (or Expression with resultType string).

AdditionalProperties

Gets or sets unmatched properties from the message are deserialized this collection

(Inherited from LinkedService)
Annotations

Gets or sets list of tags that can be used for describing the linked service.

(Inherited from LinkedService)
Authentication

Gets or sets required to specify MSI, if using Workspace resource id for databricks REST API. Type: string (or Expression with resultType string).

ConnectVia

Gets or sets the integration runtime reference.

(Inherited from LinkedService)
Credential

Gets or sets the credential reference containing authentication information.

Description

Gets or sets linked service description.

(Inherited from LinkedService)
Domain

Gets or sets &lt;REGION&gt;.azuredatabricks.net, domain name of your Databricks deployment. Type: string (or Expression with resultType string).

EncryptedCredential

Gets or sets the encrypted credential used for authentication. Credentials are encrypted using the integration runtime credential manager. Type: string (or Expression with resultType string).

ExistingClusterId

Gets or sets the id of an existing interactive cluster that will be used for all runs of this activity. Type: string (or Expression with resultType string).

InstancePoolId

Gets or sets the id of an existing instance pool that will be used for all runs of this activity. Type: string (or Expression with resultType string).

NewClusterCustomTags

Gets or sets additional tags for cluster resources. This property is ignored in instance pool configurations.

NewClusterDriverNodeType

Gets or sets the driver node type for the new job cluster. This property is ignored in instance pool configurations. Type: string (or Expression with resultType string).

NewClusterEnableElasticDisk

Gets or sets enable the elastic disk on the new cluster. This property is now ignored, and takes the default elastic disk behavior in Databricks (elastic disks are always enabled). Type: boolean (or Expression with resultType boolean).

NewClusterInitScripts

Gets or sets user-defined initialization scripts for the new cluster. Type: array of strings (or Expression with resultType array of strings).

NewClusterLogDestination

Gets or sets specify a location to deliver Spark driver, worker, and event logs. Type: string (or Expression with resultType string).

NewClusterNodeType

Gets or sets the node type of the new job cluster. This property is required if newClusterVersion is specified and instancePoolId is not specified. If instancePoolId is specified, this property is ignored. Type: string (or Expression with resultType string).

NewClusterNumOfWorker

Gets or sets if not using an existing interactive cluster, this specifies the number of worker nodes to use for the new job cluster or instance pool. For new job clusters, this a string-formatted Int32, like '1' means numOfWorker is 1 or '1:10' means auto-scale from 1 (min) to 10 (max). For instance pools, this is a string-formatted Int32, and can only specify a fixed number of worker nodes, such as '2'. Required if newClusterVersion is specified. Type: string (or Expression with resultType string).

NewClusterSparkConf

Gets or sets a set of optional, user-specified Spark configuration key-value pairs.

NewClusterSparkEnvVars

Gets or sets a set of optional, user-specified Spark environment variables key-value pairs.

NewClusterVersion

Gets or sets if not using an existing interactive cluster, this specifies the Spark version of a new job cluster or instance pool nodes created for each run of this activity. Required if instancePoolId is specified. Type: string (or Expression with resultType string).

Parameters

Gets or sets parameters for linked service.

(Inherited from LinkedService)
PolicyId

Gets or sets the policy id for limiting the ability to configure clusters based on a user defined set of rules. Type: string (or Expression with resultType string).

WorkspaceResourceId

Gets or sets workspace resource id for databricks REST API. Type: string (or Expression with resultType string).

Methods

Validate()

Validate the object.

Applies to