KnownWeightPrecision enum

Package:
@azure/arm-aiinfraoptimization

The precision a model's weights are served at.

Fields

BF16

16-bit brain floating point.
FP16

16-bit floating point.
FP32

32-bit floating point.
FP4

4-bit floating point.
FP8

8-bit floating point.
INT4

4-bit integer.
INT8

8-bit integer.