Third-party AI safety evaluation organizations step into the spotlight
Start here
According to CNBC, Anthropic and OpenAI have committed to embedding third-party evaluators internally, bringing small nonprofit evaluation organizations such as METR and Apollo Research to the center of AI safety governance. Anthropic CEO Dario Amodei last month proposed providing evaluators with desk space, badge access, company laptops, and access roughly comparable to that of the internal risk assessment team, and allowing them to publish critical findings. OpenAI subsequently released its own plan. Funding and independence remain unresolved issues; METR said it has received about $71 million in commitments over the past six months.
Generated by AI from reports · Updated 2 days ago
Progress timeline
- RedditReddit r/Anthropic· DiscussionAI’s quiet safety gatekeepers are stepping into the spotlight(opens the original post in a new tab)
- CNBC · TechnologySelectedAI's low-profile safety gatekeepers are moving into the spotlight
Anthropic and OpenAI committed to embedding third-party evaluators internally, bringing small nonprofit evaluation organizations such as METR and Apollo Research to the center of AI safety governance. Anthropic CEO Dario Amodei last month proposed providing evaluators with office space, badge access, company laptops, and access roughly equivalent to that of the internal risk assessment team, and allowing them to publish key findings; OpenAI subsequently released its own plan. Funding and independence remain unresolved issues. METR said it received about $71 million in commitments over the past six months, up from $13.6 million for all of 2024, while Anthropic said long-term funding should come from joint or government channels. OpenAI fired three employees last week, two of whom said the reason was their communication style with third-party evaluators; OpenAI denied this claim. California Governor Newsom signed two bills involving independent verification organizations (IVOs), and at the federal level Trahan and Obernolte introduced the FRONTIER Act in July.
- 网页SiliconANGLE · AI· DiscussionThe AI control gap: Who gets to say ‘It’s safe’?(opens the original post in a new tab)
Related discussion
Attention trend
New sources per day
- Oct 11New2 sources (2 outlets,0 accounts)
- Oct 12New0 sources (0 outlets,0 accounts)
- Oct 13New1 sources (0 outlets,1 accounts)