Performance & infrastructure

What is Quantization?

Shrinking a model by using lower-precision numbers so it runs faster and cheaper.

Quantization reduces the numerical precision of a model's parameters, making it smaller and faster with minimal quality loss.

It's key to running capable models on laptops, phones, and cheaper hardware.

Related terms

Browse hand-reviewed AI tools — compare on pricing, features and real ratings.