NVIDIA's Nemotron-Labs-Diffusion achieves 4x throughput in self-speculation mode on GB200 GPUs
NVIDIA's new tri-mode model, Nemotron-Labs-Diffusion, eliminates the need for a separate draft model in speculative decoding, boosting throughput.
Speculative Decoding
Latest Speculative Decoding coverage.