Foundation model trained from scratch for $1,500

Sapient researchers trained HRM-Text, a foundation LLM, from scratch for about $1,500. The model replaces standard Transformers with a Hierarchical Recurrent Model that decouples computation into strategic and execution layers. Training uses only instruction data instead of internet-scale text, dramatically cutting cost.