Anthropic 回应前 DOGE 网络研究人员用 AI Agent 渗透其系统,称攻击持续数天且未触及模型权重
前 DOGE 网络研究人员用 AI Agent 渗透 Anthropic 系统,Anthropic 的 Logan Graham 发帖更正媒体报道并说明影响范围。据《华盛顿邮报》报道,整个过程不到 12 小时,涉及讨论最敏感模型的 Slack 频道;Graham 更正称攻击尝试持续了数天,攻击者利用了两个第三方漏洞,其中一个由研究人员报告,另一个由 Anthropic 独立发现并切断访问。他表示模型权重、Claude 对话等最敏感系统未被触及,此事因涉及利用第三方和访问数据而超出公司安全港政策范围,但 Anthropic 感谢这些问题被发现。Graham 认为这预示了网络安全的未来,对手将用 AI Agent 全天候攻击包括依赖项在内的一切目标,落后当前前沿约 0.5-1 代的模型已能做到;应对上他建议持续开展红队测试,并重新设计软件系统以从根本上减少暴露面。
作者以 Anthropic 当事方身份更正媒体报道中不到 12 小时的说法,并判断落后前沿约 0.5-1 代的模型已能执行此类 Agent 攻击。
I think this story is important because it tells us about the future of cybersecurity (and of course what we can do better at Anthropic). But some of the Washington Post story / reaction on X is wrong. A few corrections:
- it didn’t take 12 hours. we saw several days of attempts. After these attempts, they exploited two 3rd party vulnerabilities, one they reported and the other we identified independently (and cut off access)
- nothing came close to our most sensitive systems, like model weights or Claude conversations
- this wasn't an ordinary bug bounty finding – this involved exploiting 3rd parties and accessing data. While this is unusual and out of scope of our safe harbor policy, we’re grateful these issues were found
From my researcher POV, the event is important because I'm concerned this is what the future will look like. Adversaries will use whatever models/tools they can. They’ll target everything with agents 24/7. They’ll hit your dependencies. I think models ~0.5-1 generations behind the current frontier can do this. And these are the dumbest models your adversaries will ever use!
So, what to do? You probably want to red team yourself all the time. Current models are *very* creative. I also think we should redesign software / systems so that you’re fundamentally less exposed. (We put out some research recently on formally verifying software and reducing attack surfaces; my mental model is basically “secure code is cheap to write now, so why not rewrite everything”)
EXCLUSIVE: In less than 12 hours, a group of ex-DOGE cyber researchers were able to penetrate Anthropic’s systems using AI agents — including Slack channels where the most sensitive models are discussed.
This is just weeks after
Anthropic whistleblower Joseph Coxon charged the company w/launching “a hubristic gamble” from a “private company’s Slack.”
Read our story here (gift link):
https://wapo.st/4smNlsC在 X 查看被引用的帖子