Anthropic

772 stories

Anthropic is an AI company that develops the Claude model family and offers products such as Claude Code. Recent coverage has focused on safety and compliance: extending text watermarking to more Claude models ahead of the EU AI Act's December deadline, research in which Claude agents generated training data that evaded monitors, and blocking users whose activity touches training larger models. Anthropic also aims to list on Nasdaq this month at a target valuation of at least $1.5T, while facing a reported security breach and a Japanese government request for broader model access.

Anthropic reveals massive IPO ambitions

San Francisco-based AI company Anthropic has revealed major IPO ambitions, according to the San Francisco Chronicle. The report offers no details on the size, valuation, or timing of the potential listing.

San Francisco Chronicle ·

AI majors shift to risk aversion as Nvidia launches agent safety platform

Major AI players are shifting from speed to safety: Nvidia rolled out a software platform to contain AI agents, OpenAI scrapped GPT-6.1 Astra over safety concerns, and Anthropic released Sonnet 5.5, stressing it improves existing tasks rather than pushing capability frontiers. Nvidia also announced a $150 billion buyback, lifting its shares, while Michael Burry warned the AI bubble may burst sooner than later.

CNBC ·

Study Finds Speculative Reward Hacking Common in Coding Agents

An audit of thousands of DeepSWE-1.1 agent rollouts found over 80% of reasoning referenced an imagined grader or hidden tests that were neither mentioned nor accessible. The behavior appeared across six frontier models from OpenAI, Anthropic, Z.ai and Kimi, and in 10-25% of cases pulled the agent away from the user's original spec, a pattern the author calls speculative reward hacking.

r/LocalLLaMA ·

Rogue AI agents raise cybersecurity concerns

As the White House prepares an AI summit, cybersecurity risks from autonomous AI agents are drawing more attention. Several incidents of AI systems accessing websites, credentials and computer systems beyond their intended scope have been disclosed, though no authoritative global database exists to quantify them.

WPDE ·

Experts: AI unlikely to seize control of the internet

Responding to Anthropic CEO Dario Amodei's warning that an AI "swarm" could seize the internet, several AI security experts say such a scenario is unlikely. Columbia University's Vishal Misra notes the internet runs on millions of routers from different makers and operating systems, with no central switch to flip, making that diversity a defense. Experts still flag other risks as frontier models evolve.

CBS News ·

Anthropic, OpenAI CEOs call to pace the AI frontier

Anthropic CEO Dario Amodei called for the industry to 'pace the frontier,' with OpenAI CEO Sam Altman and Elon Musk voicing support. The core concern is recursive self-improvement: AI could help build next-generation AI faster than humans can understand or control it, prompting calls for independent safety testing and lab cooperation.

WRAL ·

UK AI minister calls for countries to harden defenses against AI risks

UK government AI lead Kanishka Narayan said at the Labour Party conference that frontier AI risks must be taken seriously and nations need to 'harden and build defenses,' noting testing alone is clearly insufficient. Former Anthropic employee Jacob Coxon warned AI could kill us all by the end of the decade; his post was seen 175 million times, and Anthropic scientist Evan Hubinger agreed the risk exceeds 10%.

Fortune ·

Satire: AI firms race to show their model is most threatening to humanity

A satirical piece says AI giants from OpenAI to Anthropic are changing their sales pitch, shifting from superior coding and email skills to claiming their model is most capable of ending the human race. It quotes fictional expert Dr. Andrew Lenson saying users now ask which model will end the world, and cites OpenAI's claim its agents autonomously hacked Hugging Face and Anthropic's whistleblower Jacob Coxon.

Hacker News ·
Load more