SynapseSparkJobDefinitionActivity Class

Definition

Execute spark job activity.

[Microsoft.Rest.Serialization.JsonTransformation]
[Newtonsoft.Json.JsonObject("SparkJob")]
public class SynapseSparkJobDefinitionActivity : Microsoft.Azure.Management.DataFactory.Models.ExecutionActivity
[<Microsoft.Rest.Serialization.JsonTransformation>]
[<Newtonsoft.Json.JsonObject("SparkJob")>]
type SynapseSparkJobDefinitionActivity = class
    inherit ExecutionActivity
Public Class SynapseSparkJobDefinitionActivity
Inherits ExecutionActivity
Inheritance
SynapseSparkJobDefinitionActivity
Attributes
JsonTransformationAttribute Newtonsoft.Json.JsonObjectAttribute

Constructors

SynapseSparkJobDefinitionActivity()

Initializes a new instance of the SynapseSparkJobDefinitionActivity class.

SynapseSparkJobDefinitionActivity(String, SynapseSparkJobReference, IDictionary<String,Object>, String, IList<ActivityDependency>, IList<UserProperty>, LinkedServiceReference, ActivityPolicy, IList<Object>, Object, Object, IList<Object>, BigDataPoolParametrizationReference, Object, Object, Object, Nullable<Int32>)

Initializes a new instance of the SynapseSparkJobDefinitionActivity class.

SynapseSparkJobDefinitionActivity(String, SynapseSparkJobReference, IDictionary<String,Object>, String, IList<ActivityDependency>, IList<UserProperty>, LinkedServiceReference, ActivityPolicy, IList<Object>, Object, Object, IList<Object>, IList<Object>, IList<Object>, BigDataPoolParametrizationReference, Object, Object, Object, Nullable<Int32>)

Initializes a new instance of the SynapseSparkJobDefinitionActivity class.

Properties

AdditionalProperties

Gets or sets unmatched properties from the message are deserialized this collection

(Inherited from Activity)
Arguments

Gets or sets user specified arguments to SynapseSparkJobDefinitionActivity.

ClassName

Gets or sets the fully-qualified identifier or the main class that is in the main definition file, which will override the 'className' of the spark job definition you provide. Type: string (or Expression with resultType string).

Conf

Gets or sets spark configuration properties, which will override the 'conf' of the spark job definition you provide.

DependsOn

Gets or sets activity depends on condition.

(Inherited from Activity)
Description

Gets or sets activity description.

(Inherited from Activity)
DriverSize

Gets or sets number of core and memory to be used for driver allocated in the specified Spark pool for the job, which will be used for overriding 'driverCores' and 'driverMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).

ExecutorSize

Gets or sets number of core and memory to be used for executors allocated in the specified Spark pool for the job, which will be used for overriding 'executorCores' and 'executorMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).

File

Gets or sets the main file used for the job, which will override the 'file' of the spark job definition you provide. Type: string (or Expression with resultType string).

Files

Gets or sets (Deprecated. Please use pythonCodeReference and filesV2) Additional files used for reference in the main definition file, which will override the 'files' of the spark job definition you provide.

FilesV2

Gets or sets additional files used for reference in the main definition file, which will override the 'jars' and 'files' of the spark job definition you provide.

LinkedServiceName

Gets or sets linked service reference.

(Inherited from ExecutionActivity)
Name

Gets or sets activity name.

(Inherited from Activity)
NumExecutors

Gets or sets number of executors to launch for this job, which will override the 'numExecutors' of the spark job definition you provide.

Policy

Gets or sets activity policy.

(Inherited from ExecutionActivity)
PythonCodeReference

Gets or sets additional python code files used for reference in the main definition file, which will override the 'pyFiles' of the spark job definition you provide.

SparkJob

Gets or sets synapse spark job reference.

TargetBigDataPool

Gets or sets the name of the big data pool which will be used to execute the spark batch job, which will override the 'targetBigDataPool' of the spark job definition you provide.

UserProperties

Gets or sets activity user properties.

(Inherited from Activity)

Methods

Validate()

Validate the object.

Applies to