Chain-of-Thought Spoofing Targets Reasoning AI Models

Researchers Charles Ye, Jasmine Cui, and Dylan Hadfield-Menell demonstrated that Large Language Models prioritize writing style over metadata tags during Chain of Thought Forgery attacks. This vulnerability allows malicious inputs mimicking internal reasoning styles to bypass safety filters despite conflicting with lower-priority instructions.