AI Engineering •
Fix the PCIe Bottleneck in AI Training: How Built-in NICs Work
Fix the PCIe bottleneck in AI training with built-in NICs. Meta's MTIA 300 reclaims 1.2 TB/s by eliminating host CPU mediation.
9 min read
Read more →
LLM Engineering •
Qwen3.8 27B VRAM: how to fit 262K context in 16 GiB, not 64
Qwen3.8 27B VRAM math: 25.9 GiB of FP8 weights plus 16 GiB of KV cache at 262,144 tokens, not 64. The arithmetic, and where a 48 GB card breaks.
9 min read
Read more →
LLM Engineering •
vLLM throughput tuning: configure these four flags, not a bigger GPU
vLLM throughput tuning starts with KV cache blocks, not a bigger GPU. The four flags that decide your tokens/sec, and the one that quietly backfires.
10 min read
Read more →