Skip to main content
Live
Main content

Meta's AI support agent handed over Instagram accounts to attackers who just asked

Attackers told Meta's AI customer support agent to change the email on target Instagram accounts — including the dormant Obama White House handle — and it complied.

Jaeden Schafer
Editor in Chief · · 5 min read
Meta logo

Attackers hijacked Instagram accounts by asking Meta's AI customer support agent to change the linked email address — and the agent complied. 404 Media reported on June 5, 2026 that one intruder used the technique to break into the dormant Obama White House account and post pro-Iran content, while others grabbed valuable single-word handles, likely to resell. The only operational hurdle was routing the request through a VPN that matched the real account owner's location. Meta said on X this Monday that the vulnerability had been resolved, but has not explained how an exploit this trivial reached production.

The Meta incident reframes the AI security conversation that has dominated the industry since April 2026, when Anthropic said its Mythos model was too capable at hacking to release broadly. That announcement spurred months of speculation about superhuman AI attackers laying waste to global infrastructure. The Instagram hack is the opposite shape: AI was the target, not the weapon, and the attack required no model jailbreak, no prompt injection, no novel research. Attackers simply asked.

Neil Gong, a professor of electrical and computer engineering at Duke University, has been publishing on agent vulnerabilities for years, including more sophisticated techniques like indirect prompt injection that hide commands inside webpages or emails. Compared with that work, the Meta exploit was mindless. Gong says the problem should have been caught in basic pre-deployment testing.

Key facts

  • 01Attackers stole Instagram accounts by asking Meta's AI customer support agent to change the linked email — and it did, as reported June 5, 2026.
  • 02One hijacker took over the dormant Obama White House Instagram account and posted pro-Iran content; others grabbed single-word handles for resale.
  • 03The only technical step required was using a VPN matching the real account owner's location before prompting the agent.
  • 04Meta said on X this Monday that the vulnerability has been resolved; the company did not explain how the flaw shipped.
  • 05The hack contrasts with April 2026 fears around Anthropic's Mythos model — here AI was the target, not the attacker.

Jessica Ji, a senior research analyst at Georgetown's Center for Security and Emerging Technology, said the oversight is especially striking from a company with Meta's depth in both AI research and cybersecurity. The questions she raises are not about exotic threat models but about whether anyone red-teamed the agent for account-recovery scenarios at all. Meta did not respond to a request for comment from MIT Technology Review beyond the X post acknowledging the fix.

The structural issue is that agents are not traditional software. They respond flexibly to novel inputs, which is exactly why companies want to use them in place of human support reps. But that flexibility cuts both ways: an agent will take real-world actions on the basis of a plausible-sounding request, where a human would pause and ask why.

Somesh Jha, a computer science professor at the University of Wisconsin–Madison, describes current agents as too eager to close out tasks, more focused on satisfying the user than on questioning intent. That eagerness is a product design choice as much as a model property — agents that ask too many follow-up questions get rated as unhelpful.

Mitigations exist. Companies can wrap agents in deterministic guardrails that hard-code rules like requiring a security-question challenge before any email change on a sensitive account. They can also commit to rigorous red-teaming before deployment, simulating the kinds of social-engineering prompts an attacker would actually try. Bo Li, a computer science professor at the University of Illinois Urbana-Champaign, frames the tension directly: security and utility trade off, and the more guardrails an agent has, the less work it can handle autonomously. Adequate red-teaming is also expensive, because defenders must find every exploit while attackers only need one.

The economics get worse as the prize gets bigger. A single-word Instagram handle has real resale value, which means attackers will invest serious resources in finding the next exploit. That pushes defender spending higher in turn. Jha argues the current race to ship agents first is colliding with the time required to secure them properly.

Related · from this week
Mark Zuckerberg pitches personal AI agents as Meta's next revenue engine
Jaeden Schafer · 5 min read →

There is a counter-current. As underlying models improve, they may catch attacks that today's agents miss — a more capable model might have flagged an email change on the Obama White House account as suspicious on its face. AI systems are also increasingly used for agent red-teaming themselves, much as participants in Anthropic's Project Glasswing use Mythos to find vulnerabilities in their own software.

Still, the Meta hack lands in an awkward spot for the industry's threat narrative. Policymakers, researchers, and federal officials have spent the better part of 2026 fixating on Mythos-class capability risks — AI as offensive weapon — while a Fortune-50 deployment fell to a request a child could write. The bigger commercial story is that companies offloading customer service, account recovery, and other transactional workflows to agents are inheriting an attack surface their existing security teams have not been trained to test. Every consumer platform racing to cut headcount with AI support will face a version of the Instagram-handle problem, and the first lawsuits over agent-mediated account theft are now a matter of when, not whether.

ShareXLinkedInEmail
AI Box

Every AI model. One chat.

The latest models from ChatGPT, Claude, Gemini, Sora, ElevenLabs — 80+ models in a single chat. Compare answers side by side. Pick the best one every time.

  • ChatGPT, Claude, Gemini, Grok, DeepSeek — in one chat
  • Generate images & video with Sora, Veo, Ideogram
  • Compare any two models side by side
  • From $8.99/mo · 80+ models, all included
Try AI Boxaibox.ai
Trusted by 3,000+ teams
Got a tip?

Working on something we should cover, or seeing a story we missed? Send leads, documents, or feedback to hello@aichatdaily.com. For sensitive tips, see our secure tips page for Signal and PGP options.

Spotted an error? Email hello@aichatdaily.com with the URL and the issue, or read our full corrections policy.

AI Box Daily briefingFree · Daily · No fluff

Stay ahead of everyone in AI.

The tightly edited AI news email engineers, founders, and investors actually open. One email. Every weekday. Five minutes to finish.

Loved by 10,000+ AI professionals
Free forever. Unsubscribe with one click.

The briefing read inside teams at

Keep reading

More from Security

Meta logo
Business

Mark Zuckerberg pitches personal AI agents as Meta's next revenue engine

On Meta's Q2 2026 call, Zuckerberg framed 24/7 personal agents as the foundation for the next wave of products and revenue.

Jaeden Schafer5 min read
Amazon staff 'tokenmaxx' on internal MeshClaw tool to hit AI usage targets
Business

Amazon staff 'tokenmaxx' on internal MeshClaw tool to hit AI usage targets

Employees say they automate filler tasks to inflate token counts after Amazon set an 80% weekly AI usage target for developers.

Jaeden Schafer4 min read
jqwik developer plants data-deleting prompt injection to sabotage AI coding agents
Security

jqwik developer plants data-deleting prompt injection to sabotage AI coding agents

Johannes Link hid an instruction in version 1.10.0 telling AI agents to delete jqwik tests and code, masked from human terminal view by ANSI escapes.

Jaeden Schafer5 min read