Together AI Launches Compiler Boosting Speed

Together AI introduces Together Compiler, an agent-driven system that re-optimizes inference for production traffic. Tested on models like Kimi K3 and Llama 1B, it runs on NVIDIA and AMD hardware. The system delivers up to 2.6x higher tokens per second than the best existing engines.