AISiliconANGLEabout 1 hour ago
Red Hat Releases llm-d Version 1.0
8 min read
Red Hat releases llm-d version 1.0 on Oct. 20, a Kubernetes-native project for AI inference founded by Red Hat, IBM Corp., Google Cloud, CoreWeave Inc. and Nvidia. The update adds session-aware routing and multi-tenant quality-of-service controls. This move addresses enterprise needs for managing autonomous agents within secure, open infrastructure as cloud-native adoption grows.
Level
Hype check
Tap to vote and see what everyone thinks.