CloudMarkTechPostabout 1 hour ago
Buoyant Releases Open Source Kinference
1 min read
Buoyant, the company behind Linkerd, releases Kinference, an open source inference control plane for Kubernetes and vLLM. The Apache 2.0 licensed project, currently at version v0.1.0-alpha.7, manages routing policies and token rate limits for dev teams serving open-weight models.
Level
Hype check
Tap to vote and see what everyone thinks.
