FlashKDA: Moonshot's CUTLASS Kernel for Kimi Linear (2026)
May 2, 2026
Moonshot open-sourced FlashKDA, a CUTLASS CUDA kernel for Kimi Delta Attention. Drop-in for flash-linear-attention with up to 2.22x prefill speedup on H20 GPUs.
#llm-inference
Google's TurboQuant: 6x Less Memory for LLM Inference (2026)
April 6, 2026
Google's TurboQuant compresses LLM KV caches to 3 bits with zero accuracy loss, cutting memory 6x and speeding up H100 attention computation up to 8x vs FP32.
AirLLM: Run 70B Models on a 4GB GPU — Hype vs Reality
April 5, 2026
AirLLM runs 70B LLMs on a single 4GB GPU via layer-wise inference — no quantization needed. We test the claims, measure tradeoffs, and compare alternatives.