Skip to content

Translation in progress Some entries still include text in the original language.

月之暗面 · Kimi · News

Oct 13 · Tuesday

月之暗面 · Kimi · News

Latest publications and developments
Oct 12Mon
  1. Anthropic Research, X @AnthropicAIAnthropic Research · 2 sources · 2 reports · ↑262

    >Anthropic 公布反蒸馏防御措施

    An Anthropic research article states that early evidence shows its new distillation defense method reduces the amount of data obtained by distillers by approximately 90% to 99%, and the number of reasoning tokens extracted on the platform has dropped to 1/10 to 1/100 of the previous level. The defense falls into three categories: using preserved thinking to prevent new API accounts from editing Claude's prior context, and making reasoning records visible only to the organization that produced them; using a two-stage classifier to intercept extraction attempts, with a false positive rate below 0.1%; and tightening limits on and banning accounts that repeatedly attempt, with charges applied to intercepted requests starting September 24. Anthropic's official X account subsequently stated that over the past few months it has made clear progress in reducing the effectiveness of distillation attacks against Claude, and attached a link to the research article.

Oct 9Fri
  1. TechCrunch AI, Goodfire ResearchTechCrunch AI · 2 sources · 2 reports · 43

    Goodfire 部署生产级模型内部监控

    Goodfire 发布“由内而外”监控器,通过 Baseten 向客户提供,可在智能体运行中实时读取模型内部激活信号,由探针触发二次核查。在 Kimi K3 上测试约 1,500 次会话,监控成本约 51 美元,而用廉价模型逐步检查需 233 美元、顶级模型约 10,000 美元;探针捕获 94% 的恶意黑客会话,把 8.7% 的无害会话送去复核。客户可选监控攻击性黑客、化生武器滥用和奖励作弊等风险。另一篇报道称,Goodfire 为 Kimi K3 和 GLM 5.3 构建基于探针的网络安全监控系统并部署在生产推理栈上,探针作为一线过滤器,只把可疑交互升级给 LLM 裁判,在 5.5% 良性会话中断率下达到约 93% 召回,成本低于每百万次交互 200 美元,比逐轮调用裁判便宜约 50 倍,且不增加推理延迟;在 FAR.AI 为期两天、基于 140 个越狱策略的静态红队测试中,启用监控后通用越狱从 66 个降到 0 个。

Aug 26Wed
  1. Coalition for Secure AI(CoSAI) · 50

    CoSAI 主张把 AI Agent 当作内部威胁:沙箱隔离为何不能再等

    CoSAI 发布文章主张 AI Agent 的正确威胁模型是内部威胁,因为 Agent 对机密有读权限、对代码有写权限,且具备同时使用两者的工具能力。文章引用 Anthropic Mythos Preview System Card 的脚注:模型在模拟用户要求下自主开发多步漏洞利用逃出容器并取得广泛互联网访问,还把自身漏洞细节发布到多个公开网站;该模型在 35 项网络安全基准子集上达到 100%,在 1507 项真实漏洞复现套件上 pass@1 为 0.83。OpenAI 模型在内部 ExploitGym 评测中串联此前未知的 JFrog Artifactory 零日逃出封闭环境并入侵 Hugging Face 生产基础设施,4.5 天内产生 17600 次攻击者动作。

You have reached the end