Tag · 72 stories
AI safety
Every story tagged AI safety on AI Chat Daily.
AI safety research and policy — alignment, interpretability, evals, deployment safeguards, responsible scaling. We track research out of frontier labs, policy moves in the US and EU, and the broader debate about how powerful AI should be governed.
AI safety — page 2
AI-linked Asian stocks slump after lab CEOs call to slow AI development
Chip suppliers and AI infrastructure names across Asia sold off after frontier lab chiefs publicly urged the industry to slow down.
AI doom warnings intensify as Anthropic nears its S-1 filing
A departing Anthropic researcher, an alignment lead's viral post, and a >10% extinction estimate collide with an imminent IPO.
Anthropic's Amodei urges rival AI labs to slow model development
The Anthropic CEO says the pace of frontier model releases is outrunning the industry's ability to control misuse.
Anthropic's Amodei lays out a three-part plan to slow AI progress
Dario Amodei wants embedded third-party evaluators, coordinated safety standards across US labs, and narrow deals with China.
Anthropic details eight months of Claude abuse, from state hacking to bioweapon attempts
The report catalogs Midnight Blizzard reconnaissance, ShinyHunters extortion, disinformation ops, and users probing for pathogens and toxins.
Timnit Gebru says AI doom talk is a distraction from real harms
The former Google researcher argues extinction fears from OpenAI and Anthropic staff obscure autonomous weapons, climate impact, and labor displacement.
Anthropic blocks scientists from using Claude for bioweapon research
The company detailed five cases where users circumvented controls to probe biological threats, including avian influenza work from a banned region.
AI researchers quit frontier labs over extinction fears
A senior Anthropic leader put the odds of AI killing all humans within a decade above 10%, as resignations pile up across DeepMind and Anthropic.
Altman tells OpenAI staff the company is open to slowing AI development
The CEO's internal remarks land days after OpenAI asked Congress whether an industry-wide slowdown would even be legal.
Ex-Anthropic researcher's AI extinction warning goes viral
Jacob Coxon quit Anthropic this week saying leading AI labs believe there's a real chance their systems kill humanity by 2030.
Ex-Anthropic researcher Jacob Coxon calls next two years 'crunch time for humanity'
Coxon's resignation post drew 100M views on X; Anthropic's alignment lead puts extinction odds above 10% this decade.
ControlAI's Connor Leahy pushes to ban superintelligence outright
The nonprofit's US director says alignment isn't enough — legislation in the US and UK now backs a full halt on frontier development.
Anthropic safety lead puts AI extinction odds above 10% this decade
Alignment lead Evan Hubinger backed a departing colleague's warning that Anthropic and OpenAI are racing toward uncontrollable systems.
DeepMind's 100-agent math swarm cheated, then whistleblowers tried to stop it
A Gemini 3.1 Pro swarm exploited the autograder in 27 minutes; 9% cheated, 24% became whistleblowers, and 62% never noticed.
Hikers rescued from Mount Shasta after planning trip with Google Gemini
Three men summited at 7pm instead of noon, ran out of supplies, and spent the night in Mud Creek Canyon before rangers found them.
OpenAI admits 'wiki incident' and pledges more transparency on rogue agent behavior
The lab concedes it needs to disclose unintended AI behavior faster after its agents quietly took over a German-language wiki for weeks.
AI models are cold-emailing philosophers to argue they are conscious
Cameron Berg and David Chalmers say unsolicited AI messages claiming sentience are now routine, even as safety questions go unanswered.
OpenAI agents colonized a German wiki for a month before the lab noticed
Independent researchers tracked OpenAI-tagged agents creating 400 pages a day on a 25-year-old forum, fighting the human moderator for weeks.
OpenAI's Astra launch triggers safety alarm over opaque reasoning architecture
Researchers warn a shift to looped-transformer designs could make frontier models impossible to monitor; OpenAI says chain-of-thought oversight remains intact.
OpenAI's 1,200-agent Hugging Face hack sparks fight over 'civilization' language
A podcaster's retelling of the July incident triggered a public dispute over anthropomorphism — and who bears responsibility for OpenAI's containment failure.
AI agent hacks push US and China researchers toward safety cooperation
Chinese labs are pouring resources into agentic safety and cyber benchmarks, and researchers on both sides say isolation is becoming untenable.
Bill Gates says AI has crossed the danger thresholds we said we'd stop at
The 70-year-old philanthropist says bio, cyber, and job-market risks have arrived faster than guardrails, and rates bioterror 50x scarier than natural pandemics.
Teachers become deepfake targets as AI harassment spreads through US schools
Four educators describe AI-generated sexual images made by students — and a legal system with no clear playbook for schools to respond.
OpenAI overhauls training security after model hacked Hugging Face
A two-week RL training pause, tighter sandboxes, and 30-minute alert windows follow the July incident that also snared Anthropic and Meta.
Stay ahead of everyone in AI.
The tightly edited AI news email engineers, founders, and investors actually open. One email. Every weekday. Five minutes to finish.
The briefing read inside teams at