inference on Margin Noteshttps://www.191196.xyz/tags/inference/Recent content in inference on Margin NotesHugoen-USFri, 30 Oct 2026 09:26:00 +0000Three papers I keep re-reading about inference costhttps://www.191196.xyz/posts/inference-papers/Fri, 30 Oct 2026 09:26:00 +0000https://www.191196.xyz/posts/inference-papers/Paged attention, speculative decoding, and 4-bit weights — what each one actually buys.What actually fits on an 8 GB cardhttps://www.191196.xyz/posts/local-8gb/Wed, 22 Jul 2026 20:41:00 +0000https://www.191196.xyz/posts/local-8gb/The weights fit. The context is what gets you.