NVFP4

Engineers are reporting a benchmark in which the Qwen3.8-Flash-Next model, quantized in NVFP4 format, generates 184 tokens per second on a single Nvidia RTX 6000 Pro workstation GPU. The result suggests high-end consumer and workstation hardware can now serve mid-size quantized language models at speeds suitable for interactive use without a data center.