AIMarkTechPostabout 2 hours ago
AMD Releases Open MoE LLM With 2.8B Active Parameters
4 min read
AMD released Instella-MoE-16B-A3B, a fully open Mixture-of-Experts model with 16B total parameters and 2.8B active per token, trained on Instinct MI300X and MI325X GPUs. Weights from every training stage, data mixtures, configs, and inference code are published under a research-only ResearchRAIL license.
Level
Hype check
Tap to vote and see what everyone thinks.
In this storyAMD
