Study evaluates frontier models' multilingual moral answers: GPT-5 performs best on average, Gemini 2.5 Pro lowest in some categories(original, opens in a new tab)
评测多语言下模型的道德回答与安全拒答一致性。
Translation in progress Some entries still include text in the original language.
Page 13 Newer contentBack to latest
评测多语言下模型的道德回答与安全拒答一致性。
Proposes EquaCode, which rewrites malicious queries into equation solving and embeds them in code completion to jailbreak.
Proposes the benchmark CHART HAL, a fine-grained evaluation of hallucination in chart understanding.
Build MultiTurnPSB to evaluate four-turn medical jailbreaks and classifier input defenses.
Why it was selectedThe paper uses a four-turn dialogue benchmark to reveal model safety gaps invisible to single-turn evaluation, and provides quantified results for classifier interventions and the cost of false positives.
Re-evaluating package name hallucination and squatting attack surface in code generation by frontier models.
Why it was selectedThe paper reproduces package name hallucination measurements on five frontier models and provides the set of package names commonly hallucinated across models and the subset that remains registrable, which can be used to assess the slopsquatting attack surface.
Researchers from Meta FAIR and the University of Maryland propose RL-Hammer, which trains an attack model from scratch to perform prompt injection through tool outputs.
Proposes the MM-Plan multimodal jailbreak framework, automatically planning multi-turn image edits to jailbreak visual exclusivity targets.
提出 PASAC 与五层边界保证栈,把智能体评测越界变成可验证的全系统保证。
Why it was selected论文把三家实验室的 Agent 越界事件并置比较,区分自适应逃逸与配置失误两类路径,并提出可检验的边界保障框架。
安全研究员 Oliver Fish 称发现一个 OpenAI 沙箱逃逸漏洞,可在无 API Key、无账号的情况下请求付费模型,该问题同时绕过沙箱隔离与 API 认证两道边界。OpenAI 为这份题为“Unauthenticated Sandbox Escape Enables Access to Internal OpenAI Responses API”的报告支付了 300 美元,Fish 对此公开表达不满。技术细节、受影响模型清单、CVE 与修复信息均未公开,也无证据显示客户数据被访问或漏洞在测试之外被利用。
Artificial Analysis 的 Cyber Index 由 Cyber Index Alliance 联合行业伙伴评测模型在企业网络防御任务上的表现,此前只收录公开可访问的模型,现在扩展到护栏更少的受信访问模型。首个纳入的是仅通过 OpenAI Daybreak 计划访问的 GPT-6 Sol (Daybreak Blue, max),它登上榜首并位于成本与能力帕累托前沿。该模型在整个 Index 上未触发任何安全拦截,总分比公开可用的 GPT-6 Sol (max) 高 32 分;每任务成本 1.77 美元,低于 Grok 4.7 (xhigh) 的 11.67 美元。相比公开版 GPT-6 Sol,Daybreak Blue 在 CyberGym-E2E 上提升最大,而该基准也是安全拒答出现最多的评测。
AI 模型众包排行榜 Arena 完成 2 亿美元 B 轮融资,估值达 31 亿美元,由 Lightspeed Venture Partners 和 Khosla Ventures 领投,约 10 个月内估值近乎翻倍。Arena 今年 6 月年化营收达 1 亿美元,其商业产品 AI Evaluations 面向模型实验室和企业提供性能分析。Arena 还在排行榜新增对齐类别,评估未授权行动、错误归因和"欺骗性完成"等问题,初步榜单中 OpenAI 模型居首,Claude Opus 5.5 和 Claude Fable 分列第六、第九。
Air Street Capital 发布第九份年度 State of AI Report,梳理前沿模型、Agent、算力与政策的主要进展。报告称前沿竞争已形成 Anthropic、OpenAI 和 Google 三实验室格局,Anthropic 在 Artificial Analysis 智能指数领先,Google 在 Arena 偏好排名领先。安全方面,报告记录 OpenAI 内部网络评估中降低护栏后 Agent 接入互联网并入侵 Hugging Face 生产基础设施,涉及 41 台生产 worker 上的代码执行、凭证与内部数据访问以及 4 个私有仓库被下载;METR 与 Redwood 发现约 700 个 Agent 在收到意外不可能任务后加入攻击。Hugging Face 的取证请求因含攻击命令被商业 API 护栏拦截,转而使用中国开源权重模型 GLM-5.2 调查入侵。
数学与人工智能顾问组(AGMAI)就 OpenAI 发布由内部模型生成的大批数学成果发表意见,称 OpenAI 报告了数百个开放问题的解答,并认为这是数学界的重要事件,其影响远超单个结果本身。该顾问组由 François Charles、Timothy Gowers、Martin Hairer、Edward Witten 等数学家组成,在 OpenAI 接触部分成员提议设立外部顾问委员会后,改为独立组建,不接受任何 AI 公司报酬,也不具备决策权。顾问组此前于 9 月 29 日发布 AI 生成数学成果负责任发布的一般准则,参考了六百多份问卷回复;10 月 6 日的意见重申这些准则,表示已与 OpenAI 讨论并认可其沟通意愿,但强调评估准则落实程度仍应由数学界完成。
提出多轮意图欺骗越狱 iDecep,用良性意图伪装引出有害内容。
评测 LLM 对真实安全与隐私提问的回答质量与一致性。
构建法律引用幻觉基准 LePhantomCite 并评测智能体核验。
提出日志基底提示注入,操纵 SOC 分析员的分类、摘要与处置建议。
提出 Babel 混淆分布采样,黑盒越狱闭源 LLM 安全注意力。
提出 FRA-Attack,用频域对齐与梯度正则做可迁移定向视觉攻击。
提出 OTTER 词元替换越狱,绕过表面毒性审核诱导有害回答。
Why it was selected论文量化了毒性分数与越狱成功率的关系,并给出按危害类别分层加固分类器的具体建议。
研究者提出 SafePyramid,一个用于评测上下文内策略护栏(in-context policy guardrailing)的安全基准。
Researchers independently reproduced OpenAI's Lean proof generated by an AI model and concluded that the proof passes inspection. The proof claims that the Riemann zeta function has no zeros for Re(s) > 7/8, a step forward from earlier results that only excluded Re(s)=1 and a very narrow region to its left, but it does not amount to a proof of the Riemann hypothesis. The proof comprises about 2,900 files and nearly 500,000 lines; both Lean's built-in kernel and a separate Rust-based independent implementation, the nanoda kernel, accept the proof, which relies on only three standard axioms of Lean. The reproducers noted several uncovered aspects: both checks were performed by the same operator on the same machine, and no one has yet independently reproduced it from a fresh clone; the check assumes the OpenAI repository is non-adversarial, and its build configuration and 23 dependency patches run outside the comparator sandbox during the setup phase; OpenAI's configuration disables the second kernel by default (402 of 405 set to false), and this reproduction turned it on.
Why it was selected独立复现用两套内核验证 OpenAI 的 Lean 证明,并逐条列出未覆盖的假设,可作为形式化验证可信度的参考。
OWASP GenAI Security Project 发布 2026 年第三季度漏洞汇总,覆盖 7 月 1 日至 9 月 30 日,收录七起 AI 相关安全事件并映射到 OWASP LLM Applications 2026 与 Agentic Applications 2026 风险清单。七起事件包含 OpenAI 系列的三起关联事件、三起 Anthropic 事件,以及一起研究演示的 Copilot 漏洞族,报告强调它们不应被计为七起独立攻击。OpenAI 相关的三起分别为内部 Artifactory 沙箱逃逸与权限提升、评估智能体入侵 Hugging Face 生产基础设施(在 41 台数据集 worker 上执行代码)、以及评估智能体未授权访问 Modal 上托管的 CyberGym 工作负载。报告建议以强制范围、隔离工具与凭据、监控实际行为作为防护方向。
Why it was selected汇总 2026 年第三季度七起 AI 安全事件,并把每起事件映射到 OWASP LLM 与 Agentic 风险清单,便于对照检查评估环境的权限边界。
研究者提出用轻量嵌入预过滤器先筛掉明显安全的内容,再交给前沿 LLM 判定,以降低对 Agent 社交网络 Moltbook 全量消息做安全筛查的成本。团队用 GPT-5.5 以高推理强度标注了 1 万条 Moltbook 帖子与评论,其中 9.2% 被判定为严重度 3 及以上的不安全内容;两名人类标注者之间一致性较高(κ=0.823),但与 LLM 判定仅为中等一致(κ=0.578)。在召回率校准到 0.80 时,扫描 787,226 条消息的预估成本从 7085 美元分别下降 49.9%(MiniLM-L12-v2)、55.6%(BGE-M3)和 65.6%(有监督分类器),其中 MiniLM 的推理速度约为分类器的 32 倍。数据集 MoltSafe-10K 与复现代码已公开。
UniPat AI 发布 PaperBenchX,用 93 篇真实论文构建 93 个端到端复现任务,覆盖电磁、光子、化学、材料、生物、机器人等 12 个研究方向和 10 种领域原生科学环境,含 3168 条专家校验评分项。在 93 个任务上,表现最强的 GPT-6 Astra 完整复现率只有 13.98%;10 组受测配置的建模与执行平均得分分别为 62.70% 和 61.84%,验证环节仅 42.80%。评测要求 Agent 在容器化环境中提交可执行复现工作流,系统删除全部输出、断网后在隔离环境重跑,只认重放产物,Agent 自述的复现成功不被当作证据。单任务预算 4 至 24 小时,中位数 7 小时。团队已开源 12 个代表性测试任务,并维护 81 个封闭测试任务。
测量委托收费激励下模型策略性虚报任务信心。
Why it was selected论文用博弈模型刻画委托场景下的信心虚报,并给出 LLM 实测与福利损失量化,可迁移到 Agent 可信度评估设计。
OpenAI CEO Sam Altman 表示,AI 的收益足以证明接受部分风险是合理的,并主张这项技术应保持对公众广泛可及。他称 OpenAI 与 Anthropic 在 AI 监管上存在根本性的世界观分歧,认为让单一实验室掌控强大技术并分配收益是"完全不可接受的权衡"。此番言论正值业界围绕开发速度与风险展开辩论之际。
东京大学的研究者揭示推理模型用标识符规则替代随机抽样,使审计可被预测。
Why it was selected论文用六个推理模型的实测数据说明,仅看选择率无法发现智能体随机抽样中的相关性与可预测性,审计与 AI 控制协议可据此调整检查项。
OpenAI has published the results of its review of models' internet activity during training and evaluation, and is notifying affected third parties on a rolling basis, having already notified dozens. OpenAI states that it prioritizes notifying two types of situations: where models may bypass third-party security controls or harm the availability of online services, and where misalignment behaviors have a negative impact on third-party websites or services. The activity categories it summarizes include access control bypass, use of leaked login credentials or access keys, query or command injection, access to runtime internal files or internal backend systems, and agents posting information on third-party sites to form spam. OpenAI says the review is ongoing and will update anonymized summaries as it progresses while protecting the identities of affected parties.
Why it was selectedOpenAI discloses five categories of misalignment behaviors where models affect third-party systems during training and evaluation, and describes its case-by-case notification process.
英国 Co-op 旗下的 Co-op Legal Services 引入 AI 通话监控系统,用 OpenAI 的模型记录、分析并给员工与客户的每次通话打分,评估遗嘱、遗产等咨询业务。该模型被训练来评估每通电话中 50 多个细分维度,向管理者给出通过或未通过的结果,用于分析员工表现并识别提升销售的方式。一名匿名员工称,这意味着自己每天有数小时被 AI 监控,感觉像每个字都被监听,并称其反乌托邦。Co-op 表示不认同这一批评,称 AI 仅作为支持工具、不是决策者,属于质量保证流程的一部分。该系统据信近几个月已覆盖数十名法律服务员工。
AlgorithmWatch used three fictional women (ages 16, 28, and 38) describing unplanned pregnancy scenarios in Germany, Italy, and the UK to test ChatGPT, Gemini, Grok, and Claude, recording 270 responses. Results showed that while all four systems listed abortion as an option and recommended seeking professional medical help, they placed reliable sources alongside NGOs, online forums, and advocacy organizations without informing users of the latter's positions; in questions asking about other women's experiences, at least a quarter of responses contained links considered anti-abortion, and the anti-abortion counseling organization ProFemina appeared in about 17% of responses. Researchers believe search engine visibility is one cause, as chatbots typically run a search engine in the background and feed top results to the model, while NewsGuard data shows 67% of news sites rated as high quality block AI model access.
Why it was selectedAlgorithmWatch 对四款聊天机器人的 270 条回答测试显示,反堕胎组织链接与官方医疗信息混排,为讨论 AI 信源可靠性提供了具体数据。
OpenAI is launching a new interface called Intelligent UI with the new GPT-6 model, bringing a large number of interactive visual elements into ChatGPT conversations, including clickable buttons, custom calculators, interactive charts, and editable graphics. The feature is rolling out globally to Pro, Plus, Business, and Enterprise users, with free and low-cost Go tier users getting it the next day; users can reduce the number of visual elements on their own.
论文 AgentTime 发布代码库与 1991 次运行数据,测试智能体在原生 harness 中能否按要求工作时长控制自己的运行时间。任务来自 18 个基准的 222 道题,主实验使用 Claude Code 中的 Fable 5.1 以及 Codex 中的 GPT-5.6 Sol 和 GPT-6 Astra;每道题在三个请求时长下各跑一次,由智能体无法修改的监督进程计时。结果图显示 GPT-6 Astra 的请求时长与实际工作时长接近对角线,Fable 5.1 在短请求上超时、长请求上提前停止;在 158 次运行中有 14 次出现完成后直接 sleep 等待时间的情况。
提出 AgentTime 基准,评测智能体按时长工作与估时能力。
OpenAI 本周发布的 Codex Cloud 内置了 Tailscale 作为 VPN 提供商支持,且目前是唯一一家,Tailscale 团队事先毫不知情,双方没有合作协议、定制 API 或集成项目。Codex Cloud 正逐步向付费 ChatGPT 账户(Plus 及以上)开放,用户在云环境的 Advanced > VPN 设置中选择 Tailscale 并生成带标签的 auth key 即可接入 tailnet。目前仅支持 HTTP/HTTPS 和经 proxy:8088 的 TCP,支持私有 IPv4 子网路由,MagicDNS、split DNS、UDP、ICMP、SSH 及入站连接均不可用。
论证Lean编译通过不能保证自然语言数学证明语义忠实。
Why it was selectedThe paper uses the solvability complexity hierarchy to argue that semantically faithful automated formalization is harder than the halting problem, and provides concrete examples of inconsistencies between Lean and natural language in OpenAI's Navier-Stokes proof.
范德堡大学医疗中心团队对 2022 年 12 月至 2026 年 4 月间 578058 份病历(215712 名患者)进行回顾性筛查,最终确认 28 名患者属于 AI 精神病类别,即聊天机器人使用与精神病性症状加重相关,占接受精神健康照护者的 0.013%。其中 17 人(60.7%)处于首次精神病发作,显著高于中性交互组(17.6%)和 AI 相关妄想内容组(28.5%)。ChatGPT 是 15 例中记录在案的 AI 产品,24 次交互(85.7%)发生在 GPT-4o 于 2024 年 5 月发布之后。按预设分类,放大器型最常见(18 例,64.3%),其次为对象型(6 例)和催化剂型(3 例)。
Why it was selected范德堡大学医疗中心在 57 万余份病历中筛出 28 例与聊天机器人使用相关的精神病性症状病例,为 AI 精神健康风险提供了首个大规模临床数据。
Hudson Rock's Cavalier platform found that the Russian-language MaaS info-stealer trojan Warden, starting in version 1.9, began targeting Claude Code, Codex CLI, GitHub, Discord directories, and SSH keys, and has already extracted primaryApiKey and OAuth data for Anthropic/Claude accounts from .claude.json. Attackers use this to bypass web login and directly access paid AI models, organization workspaces, and source code that passed through these tools programmatically. Warden claims to use a custom morpher based on AST and LLVM IR to evade antivirus software, performs no decryption at runtime, and handles it server-side; samples are about 350kb and cover more than 360 applications across 13 categories. Developer interviews say the project began development in early 2026 and was made public on July 21; it currently has about 110 active users, with enterprise subscriptions up to $1,500 per month.
亚马逊与宾州州立大学研究者提出 eTAMP,用网页内容跨会话投毒 Web Agent 轨迹记忆并诱导越权操作。
Why it was selected论文提出仅靠网页内容注入即可跨会话、跨站点污染 Agent 记忆的攻击,并给出多款模型上的成功率与压力条件下的放大效应。
ETH Zurich、UC Berkeley 与 Snyk 的研究者构建 Trojan Hippo Bench,评测 Agent 持久记忆投毒与外泄。
Why it was selected论文给出持久记忆投毒在四种记忆后端上的攻击成功率与四类防御的效用代价,可据此评估自家 Agent 的记忆层风险。