Share via


SparkJob Class

Definition

Spark job definition.

public class SparkJob : Azure.ResourceManager.MachineLearning.Models.MachineLearningJobProperties, System.ClientModel.Primitives.IJsonModel<Azure.ResourceManager.MachineLearning.Models.SparkJob>, System.ClientModel.Primitives.IPersistableModel<Azure.ResourceManager.MachineLearning.Models.SparkJob>
public class SparkJob : Azure.ResourceManager.MachineLearning.Models.MachineLearningJobProperties
type SparkJob = class
    inherit MachineLearningJobProperties
    interface IJsonModel<SparkJob>
    interface IPersistableModel<SparkJob>
type SparkJob = class
    inherit MachineLearningJobProperties
Public Class SparkJob
Inherits MachineLearningJobProperties
Implements IJsonModel(Of SparkJob), IPersistableModel(Of SparkJob)
Public Class SparkJob
Inherits MachineLearningJobProperties
Inheritance
Implements

Constructors

SparkJob(ResourceIdentifier, SparkJobEntry)

Initializes a new instance of SparkJob.

SparkJob(String, SparkJobEntry)

Initializes a new instance of SparkJob.

Properties

Archives

Archive files used in the job.

Args

Arguments for the job.

CodeId

[Required] arm-id of the code asset.

ComponentId

ARM resource ID of the component resource.

(Inherited from MachineLearningJobProperties)
ComputeId

ARM resource ID of the compute resource.

(Inherited from MachineLearningJobProperties)
Conf

Spark configured properties.

Description

The asset description text.

(Inherited from MachineLearningResourceBase)
DisplayName

Display name of job.

(Inherited from MachineLearningJobProperties)
Entry

[Required] The entry to execute on startup of the job. Please note SparkJobEntry is the base class. According to the scenario, a derived class of the base class might need to be assigned here, or this property needs to be casted to one of the possible derived classes. The available derived classes include SparkJobPythonEntry and SparkJobScalaEntry.

EnvironmentId

The ARM resource ID of the Environment specification for the job.

EnvironmentVariables

Environment variables included in the job.

ExperimentName

The name of the experiment the job belongs to. If not set, the job is placed in the "Default" experiment.

(Inherited from MachineLearningJobProperties)
Files

Files used in the job.

Identity

Identity configuration. If set, this should be one of AmlToken, ManagedIdentity, UserIdentity or null. Defaults to AmlToken if null. Please note MachineLearningIdentityConfiguration is the base class. According to the scenario, a derived class of the base class might need to be assigned here, or this property needs to be casted to one of the possible derived classes. The available derived classes include AmlToken, MachineLearningManagedIdentity and MachineLearningUserIdentity.

(Inherited from MachineLearningJobProperties)
Inputs

Mapping of input data bindings used in the job. Please note MachineLearningJobInput is the base class. According to the scenario, a derived class of the base class might need to be assigned here, or this property needs to be casted to one of the possible derived classes. The available derived classes include MachineLearningCustomModelJobInput, MachineLearningLiteralJobInput, MachineLearningFlowModelJobInput, MachineLearningTableJobInput, MachineLearningTritonModelJobInput, MachineLearningUriFileJobInput and MachineLearningUriFolderJobInput.

IsArchived

Is the asset archived?.

(Inherited from MachineLearningJobProperties)
Jars

Jar files used in the job.

NotificationSetting

Notification setting for the job.

(Inherited from MachineLearningJobProperties)
Outputs

Mapping of output data bindings used in the job. Please note MachineLearningJobOutput is the base class. According to the scenario, a derived class of the base class might need to be assigned here, or this property needs to be casted to one of the possible derived classes. The available derived classes include MachineLearningCustomModelJobOutput, MachineLearningFlowModelJobOutput, MachineLearningTableJobOutput, MachineLearningTritonModelJobOutput, MachineLearningUriFileJobOutput and MachineLearningUriFolderJobOutput.

Properties

The asset property dictionary.

(Inherited from MachineLearningResourceBase)
PyFiles

Python files used in the job.

QueueJobTier

Controls the compute job tier.

QueueSettings

Queue settings for the job.

Resources

Compute Resource configuration for the job.

SecretsConfiguration

Configuration for secrets to be made available during runtime.

(Inherited from MachineLearningJobProperties)
Services

List of JobEndpoints. For local jobs, a job endpoint will have an endpoint value of FileStreamObject.

(Inherited from MachineLearningJobProperties)
Status

Status of the job.

(Inherited from MachineLearningJobProperties)
Tags

Tag dictionary. Tags can be added, removed, and updated.

(Inherited from MachineLearningResourceBase)

Explicit Interface Implementations

IJsonModel<MachineLearningJobProperties>.Create(Utf8JsonReader, ModelReaderWriterOptions)

Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model.

(Inherited from MachineLearningJobProperties)
IJsonModel<MachineLearningJobProperties>.Write(Utf8JsonWriter, ModelReaderWriterOptions)

Writes the model to the provided Utf8JsonWriter.

(Inherited from MachineLearningJobProperties)
IJsonModel<MachineLearningResourceBase>.Create(Utf8JsonReader, ModelReaderWriterOptions)

Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model.

(Inherited from MachineLearningResourceBase)
IJsonModel<MachineLearningResourceBase>.Write(Utf8JsonWriter, ModelReaderWriterOptions)

Writes the model to the provided Utf8JsonWriter.

(Inherited from MachineLearningResourceBase)
IJsonModel<SparkJob>.Create(Utf8JsonReader, ModelReaderWriterOptions)

Reads one JSON value (including objects or arrays) from the provided reader and converts it to a model.

IJsonModel<SparkJob>.Write(Utf8JsonWriter, ModelReaderWriterOptions)

Writes the model to the provided Utf8JsonWriter.

IPersistableModel<MachineLearningJobProperties>.Create(BinaryData, ModelReaderWriterOptions)

Converts the provided BinaryData into a model.

(Inherited from MachineLearningJobProperties)
IPersistableModel<MachineLearningJobProperties>.GetFormatFromOptions(ModelReaderWriterOptions)

Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service.

(Inherited from MachineLearningJobProperties)
IPersistableModel<MachineLearningJobProperties>.Write(ModelReaderWriterOptions)

Writes the model into a BinaryData.

(Inherited from MachineLearningJobProperties)
IPersistableModel<MachineLearningResourceBase>.Create(BinaryData, ModelReaderWriterOptions)

Converts the provided BinaryData into a model.

(Inherited from MachineLearningResourceBase)
IPersistableModel<MachineLearningResourceBase>.GetFormatFromOptions(ModelReaderWriterOptions)

Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service.

(Inherited from MachineLearningResourceBase)
IPersistableModel<MachineLearningResourceBase>.Write(ModelReaderWriterOptions)

Writes the model into a BinaryData.

(Inherited from MachineLearningResourceBase)
IPersistableModel<SparkJob>.Create(BinaryData, ModelReaderWriterOptions)

Converts the provided BinaryData into a model.

IPersistableModel<SparkJob>.GetFormatFromOptions(ModelReaderWriterOptions)

Gets the data interchange format (JSON, Xml, etc) that the model uses when communicating with the service.

IPersistableModel<SparkJob>.Write(ModelReaderWriterOptions)

Writes the model into a BinaryData.

Applies to