az cognitiveservices account managed-compute-deployment

This command group is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus

Manage managed compute deployments for Azure Cognitive Services accounts.

Commands

Name Description Type Status
az cognitiveservices account managed-compute-deployment create

Create a managed compute deployment for Azure Cognitive Services account.

Core Preview
az cognitiveservices account managed-compute-deployment delete

Delete a managed compute deployment from Azure Cognitive Services account.

Core Preview
az cognitiveservices account managed-compute-deployment list

List all managed compute deployments for Azure Cognitive Services account.

Core Preview
az cognitiveservices account managed-compute-deployment show

Show a managed compute deployment for Azure Cognitive Services account.

Core Preview
az cognitiveservices account managed-compute-deployment update

Update a managed compute deployment for Azure Cognitive Services account.

Core Preview

az cognitiveservices account managed-compute-deployment create

Preview

Command group 'cognitiveservices account managed-compute-deployment' is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus

Create a managed compute deployment for Azure Cognitive Services account.

Create a GPU-backed managed compute deployment associated with a Cognitive Services account.

az cognitiveservices account managed-compute-deployment create --model
                                                               --name
                                                               --resource-group
                                                               [--accelerator-type]
                                                               [--acquire-policy-token]
                                                               [--capacity --sku-capacity]
                                                               [--change-reference]
                                                               [--deployment-name]
                                                               [--deployment-template]
                                                               [--sku --sku-name]
                                                               [--tags]
                                                               [--version-upgrade-option]

Examples

Create a managed compute deployment.

az cognitiveservices account managed-compute-deployment create -g myResourceGroup -n myAccount --deployment-name gpt-oss-120b-gpu --model "azureml://registries/azureml-openai-oss/models/gpt-oss-120b/versions/4" --deployment-template "azureml://registries/azureml-openai-oss/deploymenttemplates/gpt-oss-120b-short-context/versions/1" --accelerator-type H100_80GB --sku-name GlobalManagedCompute --sku-capacity 1 --tags environment=production team=nlp

Required Parameters

--model

AzureML registry model URI (e.g., azureml://registries/{registry}/models/{model}/versions/{version}).

--name -n

Cognitive service account name.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Optional Parameters

The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.

--accelerator-type

GPU accelerator type (e.g., H100_80GB).

--acquire-policy-token

Acquiring an Azure Policy token automatically for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--capacity --sku-capacity

Capacity value of the Sku of Cognitive Services account/deployment.

--change-reference

The related change reference ID for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--deployment-name

Managed compute deployment name.

--deployment-template

AzureML registry deployment template URI (e.g., azureml://registries/{registry}/deploymenttemplates/{template}/versions/{version}).

--sku --sku-name

Name of the Sku of Cognitive Services account/deployment.

--tags

Space-separated tags: key[=value] [key[=value] ...]. Use "" to clear existing tags.

--version-upgrade-option

Version upgrade policy. Allowed values: OnceNewDefaultVersionAvailable, OnceCurrentVersionExpired, NoAutoUpgrade.

Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False

az cognitiveservices account managed-compute-deployment delete

Preview

Command group 'cognitiveservices account managed-compute-deployment' is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus

Delete a managed compute deployment from Azure Cognitive Services account.

az cognitiveservices account managed-compute-deployment delete --name
                                                               --resource-group
                                                               [--acquire-policy-token]
                                                               [--change-reference]
                                                               [--deployment-name]

Examples

Delete a managed compute deployment.

az cognitiveservices account managed-compute-deployment delete -g myResourceGroup -n myAccount --deployment-name gpt-oss-120b-gpu

Required Parameters

--name -n

Cognitive service account name.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Optional Parameters

The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.

--acquire-policy-token

Acquiring an Azure Policy token automatically for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--change-reference

The related change reference ID for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--deployment-name

Managed compute deployment name.

Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False

az cognitiveservices account managed-compute-deployment list

Preview

Command group 'cognitiveservices account managed-compute-deployment' is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus

List all managed compute deployments for Azure Cognitive Services account.

az cognitiveservices account managed-compute-deployment list --name
                                                             --resource-group

Examples

List all managed compute deployments.

az cognitiveservices account managed-compute-deployment list -g myResourceGroup -n myAccount

Required Parameters

--name -n

Cognitive service account name.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False

az cognitiveservices account managed-compute-deployment show

Preview

Command group 'cognitiveservices account managed-compute-deployment' is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus

Show a managed compute deployment for Azure Cognitive Services account.

az cognitiveservices account managed-compute-deployment show --name
                                                             --resource-group
                                                             [--deployment-name]

Examples

Show a managed compute deployment.

az cognitiveservices account managed-compute-deployment show -g myResourceGroup -n myAccount --deployment-name gpt-oss-120b-gpu

Required Parameters

--name -n

Cognitive service account name.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Optional Parameters

The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.

--deployment-name

Managed compute deployment name.

Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False

az cognitiveservices account managed-compute-deployment update

Preview

Command group 'cognitiveservices account managed-compute-deployment' is in preview and under development. Reference and support levels: https://aka.ms/CLI_refstatus

Update a managed compute deployment for Azure Cognitive Services account.

Only SKU (name/capacity) and tags can be updated. Model and accelerator type are immutable after creation.

az cognitiveservices account managed-compute-deployment update --name
                                                               --resource-group
                                                               [--acquire-policy-token]
                                                               [--capacity --sku-capacity]
                                                               [--change-reference]
                                                               [--deployment-name]
                                                               [--sku --sku-name]
                                                               [--tags]

Examples

Update SKU capacity of a managed compute deployment.

az cognitiveservices account managed-compute-deployment update -g myResourceGroup -n myAccount --deployment-name gpt-oss-120b-gpu --sku-capacity 2

Required Parameters

--name -n

Cognitive service account name.

--resource-group -g

Name of resource group. You can configure the default group using az configure --defaults group=<name>.

Optional Parameters

The following parameters are optional, but depending on the context, one or more might become required for the command to execute successfully.

--acquire-policy-token

Acquiring an Azure Policy token automatically for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--capacity --sku-capacity

Capacity value of the Sku of Cognitive Services account/deployment.

--change-reference

The related change reference ID for this resource operation.

Property Value
Parameter group: Global Policy Arguments
--deployment-name

Managed compute deployment name.

--sku --sku-name

Name of the Sku of Cognitive Services account/deployment.

--tags

Space-separated tags: key[=value] [key[=value] ...]. Use "" to clear existing tags.

Global Parameters
--debug

Increase logging verbosity to show all debug logs.

Property Value
Default value: False
--help -h

Show this help message and exit.

--only-show-errors

Only show errors, suppressing warnings.

Property Value
Default value: False
--output -o

Output format.

Property Value
Default value: json
Accepted values: json, jsonc, none, table, tsv, yaml, yamlc
--query

JMESPath query string. See http://jmespath.org/ for more information and examples.

--subscription

Name or ID of subscription. You can configure the default subscription using az account set -s NAME_OR_ID.

--verbose

Increase logging verbosity. Use --debug for full debug logs.

Property Value
Default value: False