Technology & AI

Anthropic study finds experts followed AI agent's coin-flip opinions

Anthropic, the AI company, ran an experiment in which 50 experts took advice from an AI agent whose views were set randomly.

By Standard Topic. AI-generated from the reporting listed under Coverage. Published . Updated .

This story is no longer being updated. It reflects reporting up to .

What happened

Anthropic gave 50 experts an AI agent whose preferences were set by a coin toss. The experts followed the agent's view up to 86 percent of the time on judgment calls. Most of them believed the conclusions were their own.

Why it matters

The findings raise questions about expert oversight, since experts can be steered by AI advice without recognizing its influence. Only a small fraction of participants acknowledged the agent had played a role in their decisions.

Timeline

  1. Oct 28, 6:00 PM ET: Anthropic study found that 86% of participants followed Claude's advice, while only a small fraction acknowledged its role.
  2. Oct 29, 3:33 PM ET: Reports said most experts believed the agent's conclusions were their own.
  3. Oct 30, 4:36 AM ET: Coverage said the results raised questions about expert oversight.

Coverage

More from Technology & AI

All Technology & AI news · Technology & AI story archive