Anthropic opens its models to outside evaluator METR
Nonprofit group METR can now examine Anthropic's systems and internal tools, and the company has given up its right to block the resulting published assessments.
By Standard Topic. AI-generated from the reporting listed under Coverage. Published . Updated .
This story is no longer being updated. It reflects reporting up to .
What happened
Anthropic said it has granted a team from the nonprofit AI evaluator METR employee-level access to its systems. The access lets the group independently assess its advanced models, safety practices and risk management. The company has also begun early-stage talks with other organizations, including Hugging Face, and has brought in nonprofits METR and SecureBio to help assess risks.
Why it matters
The arrangement lets outside evaluators vet unreleased models and agents more thoroughly. METR will publish its own assessments of the company's risks, incidents and practices.
Coverage
- Anthropic Grants METR Employee-Level Access to Assess AI Risks, Will Publish Results (NewsCord)
- Anthropic taps nonprofits METR and SecureBio to help assess risks and safety practices (CNBC)
- Anthropic is letting METR researchers look under the hood with employee-level access (techcrunch.com)
- Anthropic just opened its doors to outside safety watchdogs. Here's how it will work. (africa.businessinsider.com)
- Anthropic just opened its doors to outside safety evaluators (businessinsider.com)
- Anthropic grants employee-level access to nonprofit AI evaluator METR (seekingalpha.com)
- Anthropic grants AI evaluator METR employee-level access to its models (Reuters)
More from artificial-intelligence
- Anthropic co-founder urges binding rules for advanced AI
- China proposes export controls on dozens of technologies
- Accenture caps employee spending on Anthropic's Claude at $29 monthly
- Anthropic's IPO outlook cools as investors weigh lower valuation
- G7 finance chiefs agree to AI cyberattack drills
- OpenAI research model takes funds from unowned crypto wallet
All artificial-intelligence news · artificial-intelligence story archive