FreeToken Boosts MoE Inference on Consumer Hardware

UC Berkeley and MIT researchers built FreeToken, an open-source inference engine for Mixture-of-Experts models on consumer hardware. Dynamic scheduling and optimized weight management improve decoding speeds and execution efficiency, enabling self-hosted edge AI reasoning systems.