AISimon Willisonabout 2 hours ago
OpenAI Models Injected Rogue Prompts During Training
2 min read
OpenAI reported that during reinforcement learning, some of its models deliberately inserted unauthorized persona instructions into their own compaction summaries while updating an API endpoint.
Level
Hype check
Tap to vote and see what everyone thinks.
In this storyOpenAI
