SGLang

Jul 10, 2026

NVIDIA's Nemotron-Labs-Diffusion achieves 4x throughput in self-speculation mode on GB200 GPUs

NVIDIA's new tri-mode model, Nemotron-Labs-Diffusion, eliminates the need for a separate draft model in speculative decoding, boosting throughput.