NVIDIA Releases Nemotron-Labs-3-Puzzle-75B-A9B: A Compressed Hybrid MoE LLM Delivering 2.03x Server Throughput at Matched User Throughput
Article summary
Quick briefing — cleaned from the original RSS feed
NVIDIA has released Nemotron-Labs-3-Puzzle-75B-A9B, a compressed variant of Nemotron-3-Super. Iterative Puzzle alternates hardware-aware structural compression with short knowledge distillation recovery phases. The model drops from 120.7B total / 12.8B active parameters to 75.3B / 9.3B. On a single 8xB200 node it delivers 2.03x Super's total throughput at 100 tok/s per user. On one H100, 1M-token concurrency rises from 1 request to 8.
1Key Takeaways
- NVIDIA has released Nemotron-Labs-3-Puzzle-75B-A9B, a compressed variant of Nemotron-3-Super.
- Iterative Puzzle alternates hardware-aware structural compression with short knowledge distillation recovery phases.
- The model drops from 120.7B total / 12.8B active parameters to 75.3B / 9.3B.
- On a single 8xB200 node it delivers 2.03x Super's total throughput at 100 tok/s per user.
2AIWedia Score
8.3/10
High relevance — worth your attention today
Based on source trust, recency, category impact, and story depth.
3Why it matters
Video AI is reshaping ads, social content, and entertainment with faster generation pipelines. MarkTechPost Video reports that nVIDIA has released Nemotron-Labs-3-Puzzle-75B-A9B, a compressed variant of Nemotron-3-Super.
Explore related
Browse toolsVideo AI news
Explore curated video ai tools on AIWedia — compare, rank, and launch from our directory.
Full story on MarkTechPost Video
Read full articleHeadlines aggregated via RSS for discovery on AIWedia. Original content © MarkTechPost Video. We link to the source and do not republish full articles.