AIThe Decoderabout 1 hour ago
OpenAI cuts inference costs for ChatGPT by half
1 min read
OpenAI reduced inference costs for its AI models by more than half, applying the optimizations to ChatGPT. The number of Nvidia GPUs needed dropped to just a few hundred at times, lowering response costs for guest users.
Level
Hype check
Tap to vote and see what everyone thinks.
In this storyOpenAI
