AISpotify Engineeringabout 2 hours ago
Spotify Deploys Kong AI Gateway
1 min read
Spotify deployed Kong's AI Gateway to centralize LLM traffic across the company. The gateway routes requests to OpenAI, Vertex AI, and Spotify's Hendrix models through a single API. Over 1,000 internal services use the gateway, which adds ~40ms routing overhead and scales beyond 1,000 RPS per instance. Teams now onboard in an afternoon instead of weeks.
Level
Hype check
Tap to vote and see what everyone thinks.
In this storySpotify
