SynapseSparkJobDefinitionActivity Class

Reference

Definition

Namespace:: Microsoft.Azure.Management.DataFactory.Models

Assembly:: Microsoft.Azure.Management.DataFactory.dll

Package:: Microsoft.Azure.Management.DataFactory v8.0.0

Important

Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.

Execute spark job activity.

[Microsoft.Rest.Serialization.JsonTransformation]
[Newtonsoft.Json.JsonObject("SparkJob")]
public class SynapseSparkJobDefinitionActivity : Microsoft.Azure.Management.DataFactory.Models.ExecutionActivity

[<Microsoft.Rest.Serialization.JsonTransformation>]
[<Newtonsoft.Json.JsonObject("SparkJob")>]
type SynapseSparkJobDefinitionActivity = class
    inherit ExecutionActivity

Public Class SynapseSparkJobDefinitionActivity
Inherits ExecutionActivity

Inheritance: Object

Activity

ExecutionActivity
SynapseSparkJobDefinitionActivity

Attributes: JsonTransformationAttribute Newtonsoft.Json.JsonObjectAttribute

Constructors

SynapseSparkJobDefinitionActivity()	Initializes a new instance of the SynapseSparkJobDefinitionActivity class.
SynapseSparkJobDefinitionActivity(String, SynapseSparkJobReference, IDictionary<String,Object>, String, IList<ActivityDependency>, IList<UserProperty>, LinkedServiceReference, ActivityPolicy, IList<Object>, Object, Object, IList<Object>, BigDataPoolParametrizationReference, Object, Object, Object, Nullable<Int32>)	Initializes a new instance of the SynapseSparkJobDefinitionActivity class.
SynapseSparkJobDefinitionActivity(String, SynapseSparkJobReference, IDictionary<String,Object>, String, IList<ActivityDependency>, IList<UserProperty>, LinkedServiceReference, ActivityPolicy, IList<Object>, Object, Object, IList<Object>, IList<Object>, IList<Object>, BigDataPoolParametrizationReference, Object, Object, Object, Nullable<Int32>)	Initializes a new instance of the SynapseSparkJobDefinitionActivity class.

Properties

AdditionalProperties	Gets or sets unmatched properties from the message are deserialized this collection (Inherited from Activity)
Arguments	Gets or sets user specified arguments to SynapseSparkJobDefinitionActivity.
ClassName	Gets or sets the fully-qualified identifier or the main class that is in the main definition file, which will override the 'className' of the spark job definition you provide. Type: string (or Expression with resultType string).
Conf	Gets or sets spark configuration properties, which will override the 'conf' of the spark job definition you provide.
DependsOn	Gets or sets activity depends on condition. (Inherited from Activity)
Description	Gets or sets activity description. (Inherited from Activity)
DriverSize	Gets or sets number of core and memory to be used for driver allocated in the specified Spark pool for the job, which will be used for overriding 'driverCores' and 'driverMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).
ExecutorSize	Gets or sets number of core and memory to be used for executors allocated in the specified Spark pool for the job, which will be used for overriding 'executorCores' and 'executorMemory' of the spark job definition you provide. Type: string (or Expression with resultType string).
File	Gets or sets the main file used for the job, which will override the 'file' of the spark job definition you provide. Type: string (or Expression with resultType string).
Files	Gets or sets (Deprecated. Please use pythonCodeReference and filesV2) Additional files used for reference in the main definition file, which will override the 'files' of the spark job definition you provide.
FilesV2	Gets or sets additional files used for reference in the main definition file, which will override the 'jars' and 'files' of the spark job definition you provide.
LinkedServiceName	Gets or sets linked service reference. (Inherited from ExecutionActivity)
Name	Gets or sets activity name. (Inherited from Activity)
NumExecutors	Gets or sets number of executors to launch for this job, which will override the 'numExecutors' of the spark job definition you provide.
Policy	Gets or sets activity policy. (Inherited from ExecutionActivity)
PythonCodeReference	Gets or sets additional python code files used for reference in the main definition file, which will override the 'pyFiles' of the spark job definition you provide.
SparkJob	Gets or sets synapse spark job reference.
TargetBigDataPool	Gets or sets the name of the big data pool which will be used to execute the spark batch job, which will override the 'targetBigDataPool' of the spark job definition you provide.
UserProperties	Gets or sets activity user properties. (Inherited from Activity)

Methods

Validate()

Validate the object.

Applies to

Share via