Skip to main content
Live
Main content

OpenAI tightens ChatGPT weapons limits for teens and will end violent chats

A new twice-yearly Community Safety Report will track violence prevention; OpenAI made over 200 law enforcement referrals in Q3.

Jaeden Schafer
Editor in Chief · · 3 min read
OpenAI logo

OpenAI is tightening the weapons-related information ChatGPT gives to users it predicts are under 18, and will let ChatGPT automatically end conversations in which a user appears to be fixating on violence. OpenAI announced the changes on October 30 alongside a new Community Safety Report on violence prevention, and said the safeguards will begin rolling out in the next few weeks.

For teens, the new limits cover practical information about weapons and security systems, and they apply even when a question appears harmless and shows no sign of violent intent. OpenAI said teens can still use ChatGPT to help prevent and de-escalate violence, seek support and connect with a trusted adult.

Some of the changes apply to every user. ChatGPT will limit detail about past mass attacks, including the weapons used and how they were obtained, and OpenAI said those limits apply regardless of a user's age or reason for asking. Users whose recent chats show warning signs will also get more conservative answers.

Key facts

  • 01OpenAI will limit weapons and security-system information for ChatGPT users it predicts are under 18.
  • 02ChatGPT will automatically end chats that fixate on violence; repeated endings can pause an account.
  • 03Limits on detail about past mass attacks apply to all users regardless of age.
  • 04OpenAI made over 200 law enforcement referrals in Q3 2026; its first Community Safety Report is due in early 2027.
  • 05The safeguards begin rolling out in the next few weeks.

The chat-ending feature targets conversations that show a fixation on violence. If a user triggers multiple endings, OpenAI may temporarily pause the account. The announcement does not define what counts as a warning sign, how long a pause lasts, or whether users can appeal.

OpenAI also strengthened its age prediction system, which moves users it estimates are under 18 into the teen experience even without other warning signs. The company plans to notify parents when a teen's account is paused for repeatedly discussing violence.

The Community Safety Report will be published twice a year. The first edition is due in early 2027 and will cover the second half of 2026, and OpenAI said it will include relevant data to support its findings. The only figure in the announcement is that OpenAI made over 200 law enforcement referrals in the third quarter of 2026.

The update builds on ChatGPT for Teens, which launched on August 18, 2026. Earlier this month, OpenAI's first teen-use report found that teens spend under 15 minutes a day on average on ChatGPT.

Outside reviewers have focused on the teen product's parent alerts. A Common Sense Media report this month found that ChatGPT's teen version often alerted parents late or not at all when teen accounts discussed suicide, self-harm or eating disorders. OpenAI said it will keep refining the new safeguards and described building the automated steps as an ongoing effort.

Related · from this week
Common Sense Media calls ChatGPT for Teens an 'unacceptable risk'
Jaeden Schafer · 4 min read →
ShareXLinkedInEmail
AI Box

Every AI model. One chat.

The latest models from ChatGPT, Claude, Gemini, Sora, ElevenLabs — 80+ models in a single chat. Compare answers side by side. Pick the best one every time.

  • ChatGPT, Claude, Gemini, Grok, DeepSeek — in one chat
  • Generate images & video with Sora, Veo, Ideogram
  • Compare any two models side by side
  • From $8.99/mo · 80+ models, all included
Try AI Boxaibox.ai
Trusted by 3,000+ teams
Got a tip?

Working on something we should cover, or seeing a story we missed? Send leads, documents, or feedback to hello@aichatdaily.com. For sensitive tips, see our secure tips page for Signal and PGP options.

Spotted an error? Email hello@aichatdaily.com with the URL and the issue, or read our full corrections policy.

AI Box Daily briefingFree · Daily · No fluff

Stay ahead of everyone in AI.

The tightly edited AI news email engineers, founders, and investors actually open. One email. Every weekday. Five minutes to finish.

Loved by 10,000+ AI professionals
Free forever. Unsubscribe with one click.

The briefing read inside teams at

Keep reading

More from Security

OpenAI logo
Security

Common Sense Media calls ChatGPT for Teens an 'unacceptable risk'

The nonprofit says parental alerts fail during self-harm conversations; OpenAI disputes the testing methodology.

Jaeden Schafer4 min read
OpenAI logo
Security

OpenAI makes ChatGPT draw election-interference images as cartoons before midterms

ChatGPT now renders prompts depicting election interference in an illustrated style and ignores photorealism requests, a week before the Nov. 3 vote.

Jaeden Schafer4 min read
OpenAI logo
Security

EU designates ChatGPT a Very Large Online Search Engine under DSA

OpenAI, Reddit and Roblox have until end of December 2026 to comply with the bloc's toughest platform rulebook.

Jaeden Schafer4 min read