AIBerkeley AI Researchabout 10 hours ago
Free AI Intelligence Reshapes Data Systems
14 min read
GPT-4-class inference costs dropped from $30 per million tokens in early 2023 to under $1 today, with some providers below $0.10. This near-free intelligence creates three challenges: data systems for agents, of agents, and by agents. Agentic speculation generates 80-90% duplicate sub-queries, requiring redesigned systems that reuse results and support higher-level primitives.
Level
Hype check
Tap to vote and see what everyone thinks.
