跳到正文
原文
Ameya P.· @AmyPrb · X·· 2 天前

研究者称仍可通过第三方 API 从 Astra/Sol-6.1 提取推理内容

AI 导读

作者在推理提取攻击发布两个月后审计了厂商随后引入的缓解措施,发现仍能通过第三方 API 提供商从 Astra/Sol-6.1 中提取推理内容,并已将发现披露给 OpenAI 和 Anthropic。作者表示,企业需要覆盖的攻击面之大令人意外,攻击仍可能绕过防护;目前 Astra/Sol-6.1 的推理轨迹已对公众开放,作者也因此认为思维链监控可能相当困难。

正文

It was interesting to see how much attack surface exists for companies to cover and how we could still slip through with our attacks.

We now have Astra/Sol-6.1 traces for the public. I now see why CoT monitoring might be rough!

引用Alexander Panfilov@kotekjedi_ml
Two months after our reasoning extraction attack release, we audited mitigations introduced since then and found that we still can extract reasoning from Astra/Sol-6.1 via third-party API providers. We disclosed our findings to OpenAI and Anthropic... https://openai.com/index/disrupting-a-coordinated-model-distillation-campaign/
在 X 查看被引用的帖子

来源:Ameya P. · x.com