Quantization Basics

From float32 down to int8 and int4. Quantization scales, per-channel calibration, packing, memory savings, and the latency and accuracy tradeoffs that show up when you serve a model.

12 problems