Anthropic wants government power to block dangerous AI

Anthropic proposed giving governments legal authority to block dangerous AI models, with civil penalties tied to global annual revenue. The Advanced AI Framework applies to models trained above 10²⁵ floating-point operations by companies earning over $500 million in AI revenue. It covers four catastrophic risk categories including biological weapons and autonomous system loss of control.