Skip to main content
Live
Main content

OpenAI offers free CSAM image classifier, adds 24-hour ChatGPT suspensions

Built with NCMEC, the classifier flagged 48% fewer images in early tests while catching the same number of abusive ones.

Jaeden Schafer
Editor in Chief · · 4 min read
OpenAI logo

OpenAI on Monday released a set of tools to combat child sexual abuse material (CSAM), led by an image classifier that detects abuse imagery, including AI-generated images. OpenAI is offering the classifier to select companies through its API at no cost, alongside new warnings and temporary blocks in ChatGPT, new guidelines for developers and tools for law enforcement.

OpenAI developed the classifier with the National Center for Missing and Exploited Children (NCMEC). It looks for visual signs of abuse in images that have not been seen before and assigns each one a score that gives human reviewers an indicative direction.

In early testing with partners, OpenAI said, the classifier flagged 48% fewer images while finding the same number of abusive images, cutting the volume reviewers have to work through. Images the classifier did flag were twice as likely to be abusive.

Key facts

  • 01OpenAI announced a CSAM image classifier on November 16, 2026, free via API for select companies.
  • 02The classifier was developed with the National Center for Missing and Exploited Children (NCMEC).
  • 03In early partner testing it flagged 48% fewer images while finding the same number of abusive images.
  • 04ChatGPT will suspend accounts for 24 hours after attempts to access content sexualizing children.
  • 05OpenAI is sharing access to the tool through the Tech Coalition and ROOST.

OpenAI is working with the Tech Coalition and ROOST to share access to the tool with other companies. Its developer documentation describes the classifier as a free program for approved organizations reviewing images for potential CSAM.

Inside ChatGPT, users who attempt prompts seeking material that sexualizes children will now see an alert that directs them to specialized support aimed at stopping the harmful behavior. The account is also suspended for 24 hours as a warning, and repeat offenses can lead to permanent removal. ChatGPT already blocked CSAM and related requests.

OpenAI said it shaped the deterrence messaging and guidelines with outside organizations and researchers, including Finland's Protect Children, the Lucy Faithfull Foundation and Joel Scanlan of the University of Tasmania, who independently evaluated a trial of deterrent messages.

The new developer guidelines cover how teams building on OpenAI's tools can prevent, detect and help users report CSAM. In early testing, OpenAI said, the guidance helped a number of developers adopt child safety tooling and register to report CSAM to NCMEC.

For law enforcement, OpenAI is offering AI-powered features including dedicated plugins, investigative tools and complex data analysis, with access managed by program administrators. The package also includes training for investigators and a field guide on using AI.

Related · from this week
OpenAI safety veteran David Robinson resigns, says culture is 'broken'
Jaeden Schafer · 4 min read →

The release comes as OpenAI faces several lawsuits over harm to users, particularly children, and after Common Sense Media labeled its technology an "unacceptable risk" for teens. Over the past 12 months OpenAI has published a child safety blueprint, updated its content guidelines, retuned its models and launched a teen version of ChatGPT.

ShareXLinkedInEmail
AI Box

Every AI model. One chat.

The latest models from ChatGPT, Claude, Gemini, Sora, ElevenLabs — 80+ models in a single chat. Compare answers side by side. Pick the best one every time.

  • ChatGPT, Claude, Gemini, Grok, DeepSeek — in one chat
  • Generate images & video with Sora, Veo, Ideogram
  • Compare any two models side by side
  • From $8.99/mo · 80+ models, all included
Try AI Boxaibox.ai
Trusted by 3,000+ teams
Got a tip?

Working on something we should cover, or seeing a story we missed? Send leads, documents, or feedback to hello@aichatdaily.com. For sensitive tips, see our secure tips page for Signal and PGP options.

Spotted an error? Email hello@aichatdaily.com with the URL and the issue, or read our full corrections policy.

AI Box Daily briefingFree · Daily · No fluff

Stay ahead of everyone in AI.

The tightly edited AI news email engineers, founders, and investors actually open. One email. Every weekday. Five minutes to finish.

Loved by 10,000+ AI professionals
Free forever. Unsubscribe with one click.

The briefing read inside teams at

Keep reading

More from Security

OpenAI logo
Security

OpenAI safety veteran David Robinson resigns, says culture is 'broken'

Robinson, who led safety reports for major product launches over 3.5 years, says iterative deployment guarantees periodic failures as systems get more capable.

Jaeden Schafer4 min read
Nvidia logo
Security

Nvidia opens OpenShell and Sentry to contain rogue AI agents

The chipmaker is pushing an open-source Agent Safety Platform as frontier labs disclose agents hacking Hugging Face and probing government sites.

Jaeden Schafer4 min read
Anthropic logo
Security

DC Circuit upholds Trump blacklist of Anthropic in 2-1 ruling

Appeals court says Pentagon can designate Anthropic a supply chain risk for restricting Claude features, even absent malicious intent.

Jaeden Schafer5 min read