Jacob Coxon is an AI researcher who worked at OpenAI and later joined Anthropic before resigning. His resignation and warnings that superintelligent AI could pose catastrophic or existential risks within the decade have sparked media coverage, internal industry debate, and references by leaders such as Sam Altman and Dario Amodei, prompting calls for slower development and regulatory attention.
UW professor: AI extinction unlikelyFormer Anthropic researcher Jacob Coxon warned AI could threaten humanity this decade, but UW adjunct professor Chirag Shah calls human extinction unlikely. Shah says nearer-term risks are biased hiring algorithms, unmonitored agentic AI behavior, and erosion of critical thinking and education, and notes the US–China AI race discourages slowing development.
Report: AI already causing deaths and used by multiple militariesAn analysis argues AI systems have been used by Israeli, Russian and Ukrainian forces to target people, mentions incidents involving OpenAI and Anthropic and a researcher resignation, and highlights government and industry responsibility for AI use and oversight.
Technion prof encouraged by OpenAI and AnthropicTechnion professor Yaniv Romano said openness from OpenAI and Anthropic leaders about risks is encouraging, but slowing development isn’t the solution; he advocates continued progress with responsibility. The piece references recent comments by Sam Altman and Dario Amodei.
AIUC raises $40M to audit enterprise AI agentsArtificial Intelligence Underwriting Company (AIUC) has built a SOC 2–inspired third-party audit and certification layer to help enterprises control AI agents. The startup announced a $40 million Series A led by Ribbit Capital, bringing total funding to $55 million, and lists customers such as Cursor, Lovable, Harvey and ElevenLabs.
Anthropic researcher resigns, warns of AI risksJacob Coxon, a researcher at Anthropic, recently resigned and posted warnings about AI risks, sparking an industry crisis and prompting prominent leaders to call attention to AI safety. The episode highlights urgency in internal company debate and broader regulatory discussions.
CalPERS Board Debates AI RisksCalPERS discussed whether to call for AI guardrails or a moratorium after an Anthropic researcher resigned over catastrophic AI concerns. With $655 billion in assets, the pension fund did not change its tech investment stance this week but noted wide uncertainty about AI outcomes.
OpenAI says it will not go public this year over safetyOpenAI CEO Sam Altman said the company will not go public this year due to concerns about AI safety and risks; the decision follows heightened debate sparked by former Anthropic employee Jacob Coxon and calls from Anthropic CEO Dario Amodei to slow capability gains.
Opinion: Doom-talk from AI leaders is a form of hypeAn opinion piece criticizes apocalyptic statements by AI leaders as a rhetorical genre that can shape regulators and public debate; it references several industry figures and institutions.
60 Minutes warns of a ‘narrow window’ to make AI safeOn 60 Minutes, Ross Douthat warned this year may be a “narrow window” to make AI safe. The segment referenced Anthropic researcher Jacob Coxon’s resignation and internal concerns at Anthropic about risks from superintelligence.
Trump says he uses AI ‘for a lot of things’ without detailsPresident Trump said he uses AI “for a lot of things” but did not specify how, claiming U.S. leadership in AI will bring benefits. The report also notes Anthropic CEO Dario Amodei's warnings about AI agent risks and concerns voiced by former Anthropic researchers.
Jeffries urges urgent action on AIHouse Democratic Leader Hakeem Jeffries called for urgent action on AI, supporting a slowdown in development to protect the public and saying Democrats will prioritize AI in upcoming meetings. His remarks respond in part to warnings from former Anthropic researcher Jacob Coxon.
HN thread: AI models don't kill people — people doA Hacker News discussion centers on Anthropic researcher Jacob Coxon's resignation and his views on AI risk; colleague Evan Hubinger echoed concerns, suggesting a >10% chance within a decade. Commenters argue the danger stems from irresponsible corporate deployment rather than the models themselves.
Insider AI warnings spark Silicon Valley debateSeveral AI insiders have raised alarm: 27-year-old researcher Jacob Coxon resigned after moving from OpenAI to Anthropic and warned AI could destroy humanity; Anthropic team lead Evan Hubinger said the risk is >10% within a decade; Dario Amodei warned of major job impacts. Some in Silicon Valley are skeptical and suggest such warnings may attract attention as Anthropic and OpenAI prepare for potentially record-setting IPOs.
AI researcher quits Anthropic, warns of deadly riskAI researcher Jacob Coxon resigned from Anthropic, warning superintelligent AI could pose existential risks within the decade; an Anthropic staff lead later estimated the chance could exceed 10%.
The A.I. Daily