DigitalOcean Launches Prompt Caching for AI

DigitalOcean makes prompt caching generally available on its Serverless Inference platform today, offering up to 90% cost savings on cached input tokens and reducing time to first token by up to 80%. The feature uses cache affinity to route requests to replicas holding prior context, achieving hit rates between 85 and 95% in October 2026 testing.