VocabX Cuts AI Inference Cost by 77%

Researchers present VocabX, a method that specializes vocabulary for small language models to cut inference cost by 77%. Tested on a Portuguese essay grader, the technique reduces vocabulary rows from 152,000 to 65,000 by optimizing for compute and memory bandwidth rather than just token frequency.