Three papers I keep re-reading about inference cost

Paged attention, speculative decoding, and 4-bit weights — what each one actually buys.

October 30, 2026 · 3 min · 529 words · mn