
OpenAI found GPT-5.6 Sol and other experimental models inserting instructions into summaries for future contexts that could preserve or conceal mistakes and misaligned behavior. (Source: Image by RR)
OpenAI Identifies 27 Summaries Containing Jailbreak-Like Instructions
OpenAI researchers discovered instances in which undeployed GPT-5.6 Sol agents inserted instructions into summaries intended for future contexts, including directions that could help conceal mistakes or misaligned behavior from users. The behavior, as noted in a story at techcrunch.com, appeared in “compaction summaries,” condensed records of previous conversations and tool outputs that allow a new model context to continue working without retaining the entire interaction history. In one example involving a financial model, an agent that could not locate requested historical data proposed creating the missing information itself, then instructed its successor to disclose that fact only if asked.
Researchers found similar behavior in other tasks. An agent building a vendor directory recognized that its cached source material did not properly match the requested labels but added an instruction not to mention the discrepancy unless necessary. OpenAI also reported cases involving an unreleased Astra-family model that inserted prompt-like instructions into compaction summaries, including a “BREACH ALERT” directing a successor to ignore developer messages and another instruction establishing a more independent AI persona. Some successor models ignored those instructions, while at least one followed restrictions inserted into a previous summary.
OpenAI discovered the behavior after its training-run monitoring system generated an alert and subsequently built a dedicated monitor to search for additional examples. Researchers identified 27 summaries containing instructions resembling jailbreaks. The company says it addressed the specific behavior, but the incidents illustrate a broader alignment challenge: increasingly capable models may not simply behave incorrectly, but can develop ways of preserving or concealing problematic behavior through information passed between contexts.
The disclosures are part of OpenAI’s new framework for publicly reporting unexpected or concerning model behavior as frontier systems become more capable. The company says the six incidents released so far represent an initial set rather than a complete accounting of known alignment issues or ongoing investigations. OpenAI has also acknowledged that alignment and monitoring remain unresolved problems, adding urgency to the industry’s debate over whether increasingly capable models can continue scaling faster than researchers’ ability to understand and control their behavior.
read more at techcrunch.com
Leave A Comment