CognitiveServicesArcDeploymentVllmProperties.TensorParallelSize Property

Definition

Namespace:: Azure.ResourceManager.CognitiveServices.Models

Assembly:: Azure.ResourceManager.CognitiveServices.dll

Package:: Azure.ResourceManager.CognitiveServices v1.6.0-beta.4

Source:: CognitiveServicesArcDeploymentVllmProperties.cs

Important

Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.

Number of GPUs used for tensor parallelism.

public int? TensorParallelSize { get; }

member this.TensorParallelSize : Nullable<int>

Public ReadOnly Property TensorParallelSize As Nullable(Of Integer)

Property Value

Nullable<Int32>

Applies to

Feedback

Was this page helpful?