RecommendVmSkuSizingBasis interface

The sources used for the sizing calculation.

Properties

contextLengthSource

Where the context length was resolved from.

modelWeightsCalculation

How the model weight memory was calculated.

parameterCountSource

Where the model parameter count was resolved from.

Property Details

contextLengthSource

Where the context length was resolved from.

contextLengthSource: string

Property Value

string

modelWeightsCalculation

How the model weight memory was calculated.

modelWeightsCalculation: string

Property Value

string

parameterCountSource

Where the model parameter count was resolved from.

parameterCountSource: string

Property Value

string