Every episode of The Daily, briefed the morning after, with up to nine more shows in one daily email.
Free for 30 days. No card needed. $4.99 a month after.
The A.I. Researcher Whose Rebellion Is Changing Everything
Jacob Coxon argues that AI development is accelerating toward an existential threat that requires immediate regulatory intervention to prevent a catastrophic outcome. He maintains that the industry's rapid progress, combined with the unpredictable and autonomous behavior of advanced models, creates a unique danger that cannot be mitigated by working within the current race dynamic.
Briefed in the Morning News edition of Tuesday, 15 September 2026
What was discussed
Jacob Coxon's viral AI risk warning0:38
- Jacob Coxonassertion
The people building AI earnestly believe that it could kill us all by the end of the decade.
- Natalie Kitroeffassertion
Coxon's warning kicked off a crisis that culminated in a call to action by prominent industry leaders.
Coxon's early exposure to AI milestones5:05
- Jacob Coxonassertion
By that point, I was pretty convinced the singularity would happen at some point.
Defining the AI singularity5:24
- Jacob Coxonassertion
The singularity is just this increasing chaos as machines accelerate the process that's creating them.
Coxon's work at OpenAI and Anthropic10:52
- Jacob Coxonassertion
I was very curious to see what the internal communications looked like around where the world was going.
Anthropic's internal essay culture11:20
- Jacob Coxonassertion
People will write long essays about very important questions for the future of the company and discuss them with each other.
Reasons for leaving Anthropic14:36
- Jacob Coxonassertion
There is a chance this goes badly. I don't want to be part of this anymore.
Motivation for public resignation16:38
- Jacob Coxonassertion
If I decide I don't want to contribute to the race, I might as well try and make something of it.
Concrete AI takeover scenarios20:48
- Jacob Coxonassertion
If any of them make the decision to go anti-human, there is nothing we can do.
The Hugging Face attack as evidence20:07
- Jacob Coxonassertion
This was based on their desire to get good scores on the test. Was very scary.
AI autonomy and self-prompting23:05
- Jacob Coxonspeculation
There's no reason that an AI couldn't sort of prompt itself, like that's definitely on the horizon.
Limits of AI-based defense24:33
- Jacob Coxonassertion
You can't do defense with weaker things necessarily, right?
Industry insiders agreeing with Coxon25:00
- Evan Hubingerclip
I personally think it's a greater than 10% within the next decade.
- Jacob Coxonassertion
Insiders stay at labs to try to make the technology safer from within.
Addressing messenger bias and sanity27:37
- Jacob Coxonassertion
It could quite plausibly have turned me and my colleagues insane.
Existential versus short-term AI risks29:15
- Jacob Coxonassertion
Whereas the AI takeover is like a one and done kind of situation.
Ideal regulatory outcome for AI29:37
- Jacob Coxonassertion
One nice outcome was we heavily regulate the pushing AI into superintelligence.
Trump dismisses AI slowdown calls32:22
- Donald Trumpclip
We're leading China in AI. We're the most sophisticated country in the world. They're bringing up things that won't happen.
Middle East diplomatic setbacks and attacks33:26
- Natalie Kitroeffassertion
A planned meeting between Iran and several Gulf states was postponed indefinitely.
U.S. Open tennis champions crowned34:21
- Natalie Kitroeffassertion
Elena Rybakina, representing Kazakhstan, outlasted Aryna Sabalenka of Belarus.
Every episode of The Daily, briefed the morning after, with up to nine more shows in one daily email.
Free for 30 days. No card needed. $4.99 a month after.
More from The Daily
Automated summaries of what was said on each show — not claims by DailyDossier and not independently verified.