Lesson60 seconds
What is Quantization?
Shrinking a model so it runs faster with less memory.
Step 1 of 9
Simple Definition
Quantization reduces the numeric precision of (for example from 16-bit to 4-bit) to cut memory and often speed , with some quality trade-offs.
Explanation level
Tap a persona to hear the same idea in a totally different voice.
Try “Like I'm 5™” for a picture-book version - not the grown-up wording above.
Notebook
Your notes
Notes save automatically on this device
Knowledge graph
Done Here Next