WeightPrecision type

Package:

@azure/arm-aiinfraoptimization

The precision a model's weights are served at.
KnownWeightPrecision can be used interchangeably with WeightPrecision, this enum contains the known values that the service supports.

Known values supported by the service

FP32: 32-bit floating point.
FP16: 16-bit floating point.
BF16: 16-bit brain floating point.
FP8: 8-bit floating point.
INT8: 8-bit integer.
INT4: 4-bit integer.
FP4: 4-bit floating point.

type WeightPrecision = string