Language

RecommendVmSkuModel.HeadDim Property

Definition

The attention head dimension, used for architecture-aware key-value cache sizing. Supply all architecture fields together with a parameter count.

public int? HeadDim { get; set; }
member this.HeadDim : Nullable<int> with get, set
Public Property HeadDim As Nullable(Of Integer)

Property Value

Applies to