compute Package

This package contains classes used to manage compute targets in Azure Machine Learning.

For more information about choosing compute targets for training and deployment, see What are compute targets in Azure Machine Learning?

Modules

adla

Contains functionality for managing Azure Data Lake Analytics compute targets in Azure Machine Learning.

aks

Contains functionality for managing Azure Kubernetes Service compute targets in Azure Machine Learning.

amlcompute

Contains functionality for managing Azure Machine Learning compute targets in Azure Machine Learning.

batch

Contains functionality for managing Batch compute targets in Azure Machine Learning.

compute

Contains the abstract parent and configuration classes for compute targets in Azure Machine Learning.

computeinstance

Contains functionality for creating a fully-managed cloud-based workstation in Azure Machine Learning.

databricks

Contains functionality for managing Databricks compute targets in Azure Machine Learning.

datafactory

Contains functionality for managing Datafactory compute targets in Azure Machine Learning.

dsvm

Contains functionality for managing Data Science Virtual Machine compute targets in Azure Machine Learning.

hdinsight

Contains functionality for managing HDInsight Cluster compute targets in Azure Machine Learning.

kubernetescompute

Contains functionality for managing Azure Machine Learning compute targets in Azure Machine Learning.

kusto

Contains functionality for managing Kusto compute targets in Azure Machine Learning.

remote

Contains functionality for managing remote compute targets in Azure Machine Learning.

synapse

Manages Synapse compute targets in Azure Machine Learning service.

Classes

AdlaCompute

Manages an Azure Data Lake Analytics compute target in Azure Machine Learning.

Azure Data Lake Analytics is a big data analytics platform in the Azure cloud. It can be used as a compute target with an Azure Machine Learning pipelines. For more information, see What are compute targets in Azure Machine Learning?

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

AksCompute

Manages an Azure Kubernetes Service compute target in Azure Machine Learning.

Azure Kubernetes Service (AKSCompute) targets are typically used for high-scale production deployments because they provides fast response time and autoscaling of the deployed service. For more information, see What are compute targets in Azure Machine Learning?

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

AmlCompute

Manages an Azure Machine Learning compute in Azure Machine Learning.

An Azure Machine Learning Compute (AmlCompute) is a managed-compute infrastructure that allows you to easily create a single or multi-node compute. The compute is created within your workspace region as a resource that can be shared with other users. For more information, see What are compute targets in Azure Machine Learning?

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

BatchCompute

Manages a Batch compute target in Azure Machine Learning.

Azure Batch is used to run large-scale parallel and high-performance computing (HPC) applications efficiently in the cloud. BatchCompute is used in Azure Machine Learning Pipelines to submit jobs to an Azure Batch pool of machines using an AzureBatchStep. For more information, see What are compute targets in Azure Machine Learning?

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

ComputeInstance

Manages a cloud-based, optimized ML development environment in Azure Machine Learning.

An Azure Machine Learning compute instance is a fully-configured and managed development environment in the cloud that is optimized for machine learning development workflows. ComputeInstance is typically used to create a development environment or as a compute target for training and inference for development and testing. With a ComputeInstance you can author, train, and deploy models in a fully integrated notebook experience in your workspace. For more information, see What is an Azure Machine Learning compute instance?.

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

ComputeTarget

Abstract parent class for all compute targets managed by Azure Machine Learning.

A compute target is a designated compute resource/environment where you run your training script or host your service deployment. This location may be your local machine or a cloud-based compute resource. For more information, see What are compute targets in Azure Machine Learning?

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

DataFactoryCompute

Manages a DataFactory compute target in Azure Machine Learning.

Azure Data Factory is Azure's cloud ETL service for scale-out serverless data integration and data transformation. For more information, see Azure Data Factory.

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

DatabricksCompute

Manages a Databricks compute target in Azure Machine Learning.

Azure Databricks is an Apache Spark-based environment in the Azure cloud. It can be used as a compute target with an Azure Machine Learning pipeline. For more information, see What are compute targets in Azure Machine Learning?

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

DsvmCompute

Manages a Data Science Virtual Machine compute target in Azure Machine Learning.

The Azure Data Science Virtual Machine (DSVM) is a pre-configured data science and AI development environment in Azure. The VM offers a curated choice of tools and frameworks for full-lifecycle machine learning development. For more information, see Data Science Virtual Machine.

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

HDInsightCompute

Manages an HDInsight cluster compute target in Azure Machine Learning.

Azure HDInsight is a popular platform for big-data analytics. The platform provides Apache Spark, which can be used to train your model. For more information, see What are compute targets in Azure Machine Learning?

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

KubernetesCompute

Note

This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.

KubernetesCompute (Preview) is a customer managed K8s cluster attached to a workspace by cluster admin.

User granted access and quota to the compute can easily specify and submit a one-node or distributed multi-node ML workload to the compute. The compute executes in a containerized environment and packages your model dependencies in a docker container. For more information, see What are compute targets in Azure Machine Learning? /azure/machine-learning/concept-compute-target

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

KustoCompute

Manages a Kusto compute target in Azure Machine Learning.

Kusto, also known as Azure Data Explorer, can be used as a compute target with an Azure Machine Learning pipeline. The compute target holds the Kusto connection string and service principal credentials used to access the target Kusto cluster.

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

RemoteCompute

Manages a remote compute target for use in Azure Machine Learning.

Azure Machine Learning supports using attaching a remote compute resource to your workspace. The remote resource can can be an Azure VM, a remote server in your organization, or on-premises, as long as the resource is accessible to Azure Machine Learning. For more information, see What are compute targets in Azure Machine Learning?

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.

SynapseCompute

Note

This is an experimental class, and may change at any time. Please see https://aka.ms/azuremlexperimental for more information.

Manages an Synapse compute target in Azure Machine Learning. Currently it only supports spark.

Azure Synapse is an integrated analytics service that accelerates time to insight across data warehouses and big data analytics systems. At its core, Azure Synapse brings together the best of SQL technologies used in enterprise data warehousing, Spark technologies used for big data, and Pipelines for data integration and ETL/ELT. For more information, see What is an Synapse spark pool instance?.

Class ComputeTarget constructor.

Retrieve a cloud representation of a Compute object associated with the provided workspace. Returns an instance of a child class corresponding to the specific type of the retrieved Compute object.