AI Security •
How to Harden vLLM Inference: CVE-2025-9141 Defense Guide
How to harden vLLM inference against token exploits. CVE-2025-9141 let models run code via eval(). Separate GPU hosts from parsers.
9 min read
Read more →
LLM Engineering •
Qwen3.8 27B VRAM: how to fit 262K context in 16 GiB, not 64
Qwen3.8 27B VRAM math: 25.9 GiB of FP8 weights plus 16 GiB of KV cache at 262,144 tokens, not 64. The arithmetic, and where a 48 GB card breaks.
9 min read
Read more →
LLM Engineering •
vLLM throughput tuning: configure these four flags, not a bigger GPU
vLLM throughput tuning starts with KV cache blocks, not a bigger GPU. The four flags that decide your tokens/sec, and the one that quietly backfires.
10 min read
Read more →