Anthropic has updated the usage policy for its Claude AI chatbot in response to growing safety concerns.

The company now bans the use of Claude for developing high-yield explosives and biological, chemical, radiological, or nuclear weapons.

It also introduced stricter rules against using Claude to discover or exploit vulnerabilities, create or distribute malware, and develop tools for denial-of-service attacks.

The company narrowed its political content policy, now only prohibiting uses that are deceptive or disruptive to democratic processes, or involve voter and campaign targeting.

In May, Anthropic implemented “AI Safety Level 3” protections and highlighted risks from new features such as Computer Use, which allows Claude to take control of a user’s computer, and Claude Code, which embeds Claude in a developer’s terminal.

The new “high-risk” use case requirements now apply only to consumer-facing scenarios.

.source-ref{font-size:0.85em;color:#666;display:block;margin-top:1em;}a.ask-tia-citation-link:hover{color:#11628d !important;background:#e9f6f5 !important;border-color:#11628d !important;text-decoration:none !important;}@media only screen and (min-width:768px){a.ask-tia-citation-link{font-size:11px !important;}}

🔗 Source: The Verge

🧠 Food for thought

1️⃣ Anthropic’s policy changes reflect accelerating military AI development

The timing of Anthropic’s expanded weapons restrictions coincides with a rapid acceleration in military AI programs globally.

The U.S. Pentagon’s “Replicator” program aims to deploy thousands of autonomous systems within 18-24 months, emphasizing quick replacement of lost systems in potential conflicts1.

Recent tests have demonstrated unmanned systems capable of executing attacks without direct human oversight, raising concerns about autonomous weapons proliferation1.

This military AI arms race creates pressure on civilian AI companies to implement clearer boundaries, as the same technologies powering chatbots could potentially assist weapons development if misused.

Anthropic’s specific mention of CBRN weapons suggests recognition that advanced AI models could theoretically help with complex technical challenges in weapons design, making explicit prohibitions necessary as model capabilities improve.

2️⃣ Growing public AI concerns are driving stricter industry self-regulation

Anthropic’s policy updates align with mounting public skepticism about AI safety, with 72% of Americans now expressing concerns about privacy, cybersecurity, and algorithmic biases2.

This public wariness is creating political momentum for AI regulation, with both major parties increasingly aligned in their skepticism toward unregulated AI development2.

The company’s acknowledgment of risks from “agentic AI tools” like Computer Use reflects documented AI failures and abuses that have eroded public trust across the industry.

Companies are proactively tightening policies partly because regulatory backlash typically follows documented technology failures, as seen in previous tech industry cycles2.

The specificity of Anthropic’s new restrictions, including explicit CBRN weapons prohibitions, suggests companies recognize that vague policies won’t satisfy growing demands for accountability and transparency.

Recent Anthropic developments

……