AIMarkTechPostabout 2 hours ago
NVIDIA Releases Compressed Hybrid MoE LLM
9 min read
NVIDIA AI released Nemotron-Labs-3-Puzzle-75B-A9B, a compressed variant of Nemotron-3-Super. The model drops from 120.7B to 75.3B total parameters and 12.8B to 9.3B active parameters. It delivers up to 2.14x server throughput on 8xB200 nodes and enables 8 concurrent 1M-token requests on a single H100, up from 1.
Level
Hype check
Tap to vote and see what everyone thinks.
In this storyNvidia
