AITechmemeabout 1 hour ago
Compute Efficiency Gains Driven by Data
1 min read
From 2019 to 2025, gains in pretraining compute efficiency came mostly from data improvements rather than model improvements, according to analysis discussed on the Dwarkesh Podcast. The finding separates data scaling from architectural advances.
Level
Hype check
Tap to vote and see what everyone thinks.
