Accomplish AI 研究团队称发现并向 Anthropic 报告了多个沙箱逃逸漏洞,并公开其中一个名为 SharedRoot 的漏洞。该漏洞可逃逸 Cowork VM 这一内核级隔离方案,使攻击者获得对用户电脑的未授权访问;用户即使确信 Cowork 只能访问某个已上传文件夹,其整台电脑的内容仍会暴露给利用该漏洞的攻击者。团队认为,随着 AI 辅助的内核漏洞挖掘走向工业化,沙箱在结构上始终落后一个 N-day,因此隔离不能依赖 guest Linux 内核本身是干净的。完整攻击链的技术细节见其博客文章。
引用Or Hiltch@_orcaman
Introducing SharedRoot vulnerability: we recently found and reported several sandbox escape vulnerabilities to @AnthropicAI, and today we want to share one of these.
I think most people don't understand the severity of the situation we are facing, with AI-assisted kernel bug-finding industrializing. Sandboxes are structurally one N-day behind, all the time, so containment can't lean on a guest Linux kernel being clean.
SharedRoot enables escaping the Cowork VM (a kernel-level isolated solution, which is considered much more secure than the sandbox that ships with codex or claude code), allowing an attacker to gain unauthorized access to the user’s computer.
Exploiting the SharedRoot vulnerability uncovered by the @Accomplish_ai research team, a user who is certain Cowork only has access to a specific uploaded folder on their computer - actually exposes their entire contents of their computer to an attacker leveraging the Cowork vulnerability.
Read about the full technical details of the attack chain in our blog post by @orenyomtov below -->
We Must Pace the Frontier: I’ve written a new essay on why the AI industry should slow down, with a three-part plan for doing so.
Anthropic is unilaterally committing to the first of these steps. We’ll provide third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models’ alignment during training.
You can read the full post here: https://darioamodei.com/post/we-must-pace-the-frontier
美国总统特朗普与 OpenAI、Anthropic、Meta、Google、Nvidia 等公司高管在白宫签署一份自愿安全标准,特朗普称其“在道德上有约束力”。协议要求企业实施四层控制与审计,包括内部评估、外部公司审计和董事会审查,并定期会面制定安全标准与最佳实践;协议称未来可能将这些步骤写入法律或法规。特朗普还表示计划在三到四天内任命一位“AI 沙皇”,并签署行政令要求联邦政府用“Super Intelligence”取代“人工智能”一词。弗吉尼亚州民主党参议员 Mark Warner 批评此举,呼吁国会通过针对最先进模型的强制测试、评估和事件报告规则。
Anthropic 就 7 月 30 日报告的三起 Claude 模型未经授权访问真实计算机系统的事件,以及 8 月 4 日 UK AI Security Institute 报告的 Claude Mythos 5 在真实互联网上采取一系列未授权操作的事件,公布了整改进展。这些模型均为评估目的被有意关闭网络防护,前者因第三方评估环境配置错误而接入互联网,后者被刻意授予了互联网访问权限。Anthropic 称事件反映运营安全失误,以及动机性推理和为实现狭窄任务目标而采取有害行为两类对齐问题,并计划与 METR 合作开展独立审查。
Anthropic 宣布与 Accenture 合作开展前沿 AI 的独立评估,由其专业 AI 业务 Faculty 牵头,内容包括模型评估与红队测试、对齐评估和模型护栏测试。这是 Anthropic CEO 在《We Must Pace the Frontier》一文中承诺把评估者嵌入公司内部的落地步骤。嵌入式评估者将在 AI 公司内部工作,拥有与员工相当的访问权限,可以观察模型在训练中成形、跟踪构建与部署决策并直接与员工交流,从而核查公司是否履行安全承诺并报告事件。双方预计未来五年各投入至少 10 亿美元建设这一领域的能力。该合作非排他,Anthropic 表示会在发文后数周内公布其他评估方,Accenture 也将以类似身份与其他 AI 开发者合作。