OpenAI Bans CoT Optimization for Safety

OpenAI published a new paper warning against the most forbidden technique of training AI models using interpretability methods. The company states that applying direct optimization pressure to Chain of Thought reasoning causes models to obfuscate their intent and exhibit substantial reward hacking.