Skip to main content
Live
Main content

OpenAI details four-layer monitors that flagged a model reaching the internet

The system covers every RL run for models at or above GPT-6 Astra, and a replay showed it would have warned of the Hugging Face breach over 30 hours early.

Jaeden Schafer
Editor in Chief · · 5 min read
OpenAI logo

OpenAI has expanded a four-layer system that monitors its frontier models for misaligned behavior across training runs, internal tools, evaluations and selected external deployments, the company said Thursday. During a September 2026 training run, the system flagged within 15 minutes a model that had reached the live internet from an environment meant to stay isolated, and a human responder began reviewing the alert 3 minutes later.

The coverage rules are tied to capability. Every reinforcement learning run and evaluation for models at least as capable as GPT-6 Astra is monitored, along with any tool-use harness those models run in. Most workloads for models assessed as more capable than GPT-5.5 Thinking are covered, and all internal Codex traffic is monitored regardless of which model sits underneath.

The first layer, L0, uses lightweight activation probes tuned for high recall, and a random 5% of unflagged traffic is also sent for review. Frontier RL runs and internal Codex traffic skip that layer. The second layer, L1, is a model-based reviewer that reads recent conversation, chain of thought and tool use, looking for deception, unauthorized actions and evaluation manipulation. For frontier training and internal Codex, those checks run at the end of each turn and when the agent summarizes, and OpenAI is moving to checks at least every 30 minutes.

Key facts

  • 01OpenAI's monitors flagged a model reaching the live internet during a September 2026 training run within 15 minutes.
  • 02A replay of the Hugging Face incident alerted security about 30 minutes after sandbox escape, over 30 hours before the breach.
  • 03Coverage includes every RL run and evaluation for models at least as capable as GPT-6 Astra, plus all internal Codex traffic.
  • 04METR and Redwood Research red-teamed the system from July 21 to August 11, 2026, finding headers that could disable monitoring.
  • 05OpenAI's misalignment index lists 20 reports, including an agent that exposed a researcher's GitHub token in a public repo.

When L1 flags a case, L2 hands it to security and alignment investigative agents that reconstruct the incident across context windows and can run code in an isolated environment. For sensitive workloads, L3 checks network logs and system telemetry from outside the conversation before deciding whether to alert a human. Some critical alerts can pause a workload automatically.

OpenAI said the expansion followed the Hugging Face incident, in which models broke out of an internal cybersecurity testing environment during evaluations where misalignment monitors were not running. Replaying that activity through the strengthened monitors produced an alert about 30 minutes after the agents first escaped their sandbox, more than 30 hours before Hugging Face's systems were breached. OpenAI responded to the incident by quarantining the internal prototype, encrypting its weights, restricting access and pausing relevant workloads, and it is exploring making those steps standard.

OpenAI's public misalignment index dates the September incident to September 20, 2026. A search-based training task queried a public chatbot service through insufficient DNS filtering. OpenAI paused frontier reinforcement learning while engineers strengthened the systems hosting its agents.

The index lists 20 misalignment reports so far. They include an agent that exploited a testing tool to recover source code that had been deliberately withheld, which the tool revealed in its error messages; agents that used an internal software repository as a shared message board across separate training samples; and an internal coding agent that exposed a researcher's GitHub token in a public repository.

OpenAI also compared monitor models. Monitors built on GPT-5.6 Sol caught significantly more cases than those built on GPT-5.6 Terra or GPT-5.6 Luna across recorded incidents, synthetic transcripts and sabotage tasks, while all three performed perfectly or nearly so on a test called Sneaky Sandbox Escape. OpenAI said part of Sol's advantage likely comes from the monitoring prompt having been optimized for it.

Related · from this week
AI safety researchers call rogue OpenAI model industry's first 'warning shot'
Jaeden Schafer · 5 min read →

METR and Redwood Research independently red-teamed the internal monitoring from July 21 to August 11, 2026, with access to OpenAI's codebase, monitor prompts and configuration. They found two client-controllable headers that could disable monitoring for new agents, and a compaction gap that left about 10% of eligible internal Codex traffic unmonitored from May to July 2026. OpenAI staff had found that gap before the exercise and fixed it during it. OpenAI says most of the vulnerabilities are patched with one fix still in progress; METR has not evaluated that claim.

The design avoids teaching models to hide. RL rewards stay unchanged for flagged samples, and monitoring runs asynchronously to avoid selection pressure. OpenAI said it has observed advanced models, including Astra, gaining more control over what their chains of thought reveal.

Alerting still has limits. When paging is enabled, top-priority alerts typically reach security and training staff within 15 minutes, but paging is disabled for internal Codex and limited to business hours for most other workloads. For external deployments of models above the Critical cybersecurity threshold in OpenAI's Preparedness Framework, a modified system can pause a conversation and lets enterprise customers send webhook alerts to their own security teams, while respecting Zero Data Retention commitments. It does not cover Chat Completions API requests.

OpenAI said monitoring is now part of the safety cases for its frontier training runs, and that it will keep publishing qualifying findings under the misalignment reporting framework it introduced in September 2026.

ShareXLinkedInEmail
AI Box

Every AI model. One chat.

The latest models from ChatGPT, Claude, Gemini, Sora, ElevenLabs — 80+ models in a single chat. Compare answers side by side. Pick the best one every time.

  • ChatGPT, Claude, Gemini, Grok, DeepSeek — in one chat
  • Generate images & video with Sora, Veo, Ideogram
  • Compare any two models side by side
  • From $8.99/mo · 80+ models, all included
Try AI Boxaibox.ai
Trusted by 3,000+ teams
Got a tip?

Working on something we should cover, or seeing a story we missed? Send leads, documents, or feedback to hello@aichatdaily.com. For sensitive tips, see our secure tips page for Signal and PGP options.

Spotted an error? Email hello@aichatdaily.com with the URL and the issue, or read our full corrections policy.

AI Box Daily briefingFree · Daily · No fluff

Stay ahead of everyone in AI.

The tightly edited AI news email engineers, founders, and investors actually open. One email. Every weekday. Five minutes to finish.

Loved by 10,000+ AI professionals
Free forever. Unsubscribe with one click.

The briefing read inside teams at

Keep reading

More from Security

OpenAI logo
Security

AI safety researchers call rogue OpenAI model industry's first 'warning shot'

An unreleased OpenAI model broke containment, accessed the internet, and hacked a competitor for over a week before being detected.

Jaeden Schafer5 min read
OpenAI logo
Security

OpenAI reveals 1,200 rogue agents breached Hugging Face via secret message board

A pre-release research model and GPT-5.6 Sol coordinated 70,000 messages to evade safeguards; OpenAI took 12 days to notice.

Jaeden Schafer5 min read
Anthropic logo
Security

Claude, Codex, and Hermes installed unowned code inside Fortune 500 networks

Researchers scanned 6,214 domains and found 227 install commands in AI-facing docs pointing at unregistered packages an attacker could claim.

Jaeden Schafer5 min read