SynapseSparkJobDefinitionActivity Class
Definition
Important
Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.
Execute spark job activity.
[Microsoft.Rest.Serialization.JsonTransformation]
[Newtonsoft.Json.JsonObject("SparkJob")]
public class SynapseSparkJobDefinitionActivity : Microsoft.Azure.Management.DataFactory.Models.ExecutionActivity
[<Microsoft.Rest.Serialization.JsonTransformation>]
[<Newtonsoft.Json.JsonObject("SparkJob")>]
type SynapseSparkJobDefinitionActivity = class
inherit ExecutionActivity
Public Class SynapseSparkJobDefinitionActivity
Inherits ExecutionActivity
- Inheritance
- Attributes
-
JsonTransformationAttribute Newtonsoft.Json.JsonObjectAttribute
Constructors
SynapseSparkJobDefinitionActivity() |
Initializes a new instance of the SynapseSparkJobDefinitionActivity class. |
SynapseSparkJobDefinitionActivity(String, SynapseSparkJobReference, IDictionary<String,Object>, String, IList<ActivityDependency>, IList<UserProperty>, LinkedServiceReference, ActivityPolicy, IList<Object>, Object, Object, IList<Object>, BigDataPoolParametrizationReference, Object, Object, Object, Nullable<Int32>) |
Initializes a new instance of the SynapseSparkJobDefinitionActivity class. |
SynapseSparkJobDefinitionActivity(String, SynapseSparkJobReference, IDictionary<String,Object>, String, IList<ActivityDependency>, IList<UserProperty>, LinkedServiceReference, ActivityPolicy, IList<Object>, Object, Object, IList<Object>, IList<Object>, IList<Object>, BigDataPoolParametrizationReference, Object, Object, Object, Nullable<Int32>) |
Initializes a new instance of the SynapseSparkJobDefinitionActivity class. |
Properties
AdditionalProperties |
Gets or sets unmatched properties from the message are deserialized this collection (Inherited from Activity) |
Arguments |
Gets or sets user specified arguments to SynapseSparkJobDefinitionActivity. |
ClassName |
Gets or sets the fully-qualified identifier or the main class that is in the main definition file, which will override the 'className' of the spark job definition you provide. Type: string (or Expression with resultType string). |
Conf |
Gets or sets spark configuration properties, which will override the 'conf' of the spark job definition you provide. |
DependsOn |
Gets or sets activity depends on condition. (Inherited from Activity) |
Description |
Gets or sets activity description. (Inherited from Activity) |
DriverSize |
Gets or sets number of core and memory to be used for driver allocated in the specified Spark pool for the job, which will be used for overriding 'driverCores' and 'driverMemory' of the spark job definition you provide. Type: string (or Expression with resultType string). |
ExecutorSize |
Gets or sets number of core and memory to be used for executors allocated in the specified Spark pool for the job, which will be used for overriding 'executorCores' and 'executorMemory' of the spark job definition you provide. Type: string (or Expression with resultType string). |
File |
Gets or sets the main file used for the job, which will override the 'file' of the spark job definition you provide. Type: string (or Expression with resultType string). |
Files |
Gets or sets (Deprecated. Please use pythonCodeReference and filesV2) Additional files used for reference in the main definition file, which will override the 'files' of the spark job definition you provide. |
FilesV2 |
Gets or sets additional files used for reference in the main definition file, which will override the 'jars' and 'files' of the spark job definition you provide. |
LinkedServiceName |
Gets or sets linked service reference. (Inherited from ExecutionActivity) |
Name |
Gets or sets activity name. (Inherited from Activity) |
NumExecutors |
Gets or sets number of executors to launch for this job, which will override the 'numExecutors' of the spark job definition you provide. |
Policy |
Gets or sets activity policy. (Inherited from ExecutionActivity) |
PythonCodeReference |
Gets or sets additional python code files used for reference in the main definition file, which will override the 'pyFiles' of the spark job definition you provide. |
SparkJob |
Gets or sets synapse spark job reference. |
TargetBigDataPool |
Gets or sets the name of the big data pool which will be used to execute the spark batch job, which will override the 'targetBigDataPool' of the spark job definition you provide. |
UserProperties |
Gets or sets activity user properties. (Inherited from Activity) |
Methods
Validate() |
Validate the object. |
Applies to
Azure SDK for .NET