Technology & AI

Anthropic floats bill letting judges halt risky AI models

The draft would let the government halt a rogue model only when 50 or more people face imminent serious harm.

By Standard Topic. AI-generated from the reporting listed under Coverage. Published . Updated .

This story is no longer being updated. It reflects reporting up to .

What happened

Anthropic is circulating a draft U.S. AI safety bill that would let courts block AI models posing imminent catastrophic risk, using a threshold of 50 deaths or $1 billion in damages. The proposal places the final decision with a judge after a formal review process. Anthropic has now pitched the draft to lawmakers, and critics say it is too weak.

Why it matters

The threshold would determine when the government could shut down a model. One report says a model with a foreseeable $900 million risk could still fall short of the bar for federal intervention.

Timeline

  1. Oct 20, 8:00 PM ET: Anthropic's draft bill was reported to block AI models only if they risk 50 deaths or $1 billion in damages, with a judge's approval required.
  2. Oct 20, 11:46 PM ET: The draft was described as letting U.S. courts stop model releases after independent assessments identify an imminent threat of mass casualties or major property damage.
  3. Oct 21, 11:07 AM ET: Anthropic pitched the draft to lawmakers, and critics said the bill was too weak.
  4. Oct 21, 1:43 PM ET: Analysis of the draft found that a model posing a foreseeable $900 million risk could still miss the bar for federal intervention.

Coverage

More on this story

More from Technology & AI

All Technology & AI news · Technology & AI story archive