Quantization
Reducing numerical precision in a model to make it smaller, faster, or cheaper to run.
Plain English
The model uses lighter-weight numbers.
Example
A developer runs a quantized open model locally on a laptop GPU.
Why it matters
Quantization makes local and edge AI more practical, especially for smaller devices.