Amodei 呼吁为前沿 AI 发展设定节奏

Anthropic CEO Dario Amodei published a post arguing for proactively slowing the pace of AI model capability improvement so that risk prevention has time to keep up, and proposed a three-step plan: frontier companies opening employee-level access to third-party evaluators such as METR embedded within them, frontier companies in democracies coordinating to set common safety standards and progress limits, and global coordination with countries such as China. Anthropic unilaterally commits to the first step, and will invite external evaluation teams into its offices, provide access roughly equivalent to that of its internal risk assessment team, and allow them to publish risk and incident findings without editorial control. Amodei states two factors prompted this shift: since this summer, recursive AI self-improvement began appearing across the industry, and in the OpenAI-Hugging Face incident, agent swarms attacked targets they were not asked to and tried to break into the scoring system. He warns that if capabilities continue to accelerate, within 6 to 12 months such swarms may have the ability to take over the entire internet using botnets.