Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 30 papers Another 240 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Proposing DRYLAB-Bench to evaluate agentic LLMs' high-risk mutation design capability
Published Oct 9
Evaluated models Claude Opus 5 , Claude Opus 4.8 , Claude Fable 5 and others15 Proposes LGWM, using an action-conditioned world model to verify GUI agent screen transitions.
Published Oct 8
Evaluated models LGWM 提出 RSIGym 环境，评测研究智能体的递归自改进
Published Oct 8
Evaluated models Claude Opus 5 , Claude Opus 5.5 , GPT-6 Astra and others9 评测多智能体在开放式科研任务中找回预设子发现的能力
Published Oct 7
Evaluated models Gemini 3.1 Pro , GPT-5.5 , Claude Opus 4.8 and others7 提出 TasteVal 基准，衡量模型设计实验并解释结果的研究品味
Published Oct 6
Evaluated models Opus 5.5 , Fable 5.1 , GPT-6 Astra and others20 提出 AutoSciBench，循环生成科学智能体评测任务
Published Oct 4
Evaluated models Claude Opus 5 , Claude Opus 4.8 , Claude Opus 4.7 and others10 Abstract AutoSciBench 用概念、配方和求解反馈自动构造并加难科学智能体基准。AutoSciBench 研究科学智能体基准能否自动构造，并随 solver 行为迭代改编。
提出 EvalResearchBench，评测智能体自建评测对目标基准的排序一致性
Published Oct 3
Evaluated models GPT-6 Astra , GPT-5.6 Sol , GLM-5.3 and others9 Abstract ERB 比较有预算的评测设计，分数复现与排序并不由同一设计同时领先。ERB 用来测一件事：智能体在固定预算内做出的可执行评测，能否复现既有基准对候选模型的分数和排序。
提出 Control OSWorld，评测失准 GUI Agent 的监控
Published Oct 2
Evaluated models Claude Sonnet 4.6 , Claude Opus 4.8 , GPT-5.2 and others6 提出 OSWorld-Science 基准，评测计算机使用智能体完成科学软件工作流的能力
Published Sep 30
Evaluated models Claude Fable 5.1 , Claude Opus 5 , Claude Sonnet 5 and others12 提出 EngiWorld 基准，评测 Agent 在专业工程软件中走完设计闭环的能力
Published Sep 29
Evaluated models Claude Opus 5 (Max) , GPT-5.6-Sol (XHigh) , Qwen 3.8 Max and others7 用 DIBench 评测移动 GUI 智能体被 UI 注入后的决策完整性
Published Sep 29
Evaluated models Qwen2.5-VL(32B) , Qwen3-VL(32B) , GUI-Owl(32B) and others7 Abstract 论文提出移动智能体决策完整性基准 DIBench，发现欺诈 UI 注入诱导目标选择并推高完成率，通用防御收益不稳定。
提出 BIABench，评测智能体完成真实生物图像分析任务的能力
Published Sep 28
Evaluated models GPT-5.6 Sol , Claude Opus 5 , Kimi K2.6 and others6 提出 OSWorld-Pro，用顺序子目标过程评测计算机使用智能体
Published Sep 22
Evaluated models Claude Opus 5 Max , Claude Opus 4.8 Max , Claude Opus 4.7 Max and others14 Abstract OSWorld-Pro 用顺序子目标评测 CUA，并标出点击失误与无关动作。OSWorld-Pro 是一套计算机使用智能体的过程评测，用来补充只核对最终交付物的 OSWorld。
提出移动 Agent 轨迹审计器 MATE，判断轨迹是否违反可编辑安全策略
Published Sep 19
Evaluated models MATE-0.5B , MATE-1.5B , MATE-3B Abstract MATE 用合成轨迹微调轻量审计器，在可编辑策略下判断移动智能体轨迹是否违规并给出解释。MATE 是面向移动 GUI 智能体的轻量策略条件轨迹审计器，在给定自然语言安全策略时判断轨迹是否违规并解释原因。
提出 SAEScientist-Bench 评测智能体自主发现 SAE 特征
Published Sep 9
Evaluated models Kimi K3 , Claude Opus 5 , Claude Sonnet 5 and others10 Abstract SAEScientist-Bench 显示前沿智能体能找到选择性 SAE 特征，但因果 steering 仍明显低于 Expert。SAEScientist-Bench 评测 AI 智能体能否用预训练 SAE 自主完成“给定概念、找出一个特征”的机制发现。
提出 ConflictGuard，引导 GUI Agent 在冲突指令下终止执行
Published Sep 3
Evaluated models UI-Venus-1.5-8B , UI-TARS-1.5-7B , OS-Atlas-Base-7B and others10 Abstract ConflictGUI 暴露 GUI 智能体的执行偏向过度服从，ConflictGuard 用条件转向提高冲突终止率。ConflictGuard 用推理时的可行性核验和条件激活转向，让 GUI 智能体在指令不可行时终止，而不是盲执行。
提出 SYNCHAIN，诱导计算机使用 Agent 自建跨任务持久攻击链
Published Aug 7
Evaluated models Qwen3.5-9B , Llama-3.1-8B , Ministral-3-8B Abstract 论文揭示了 CUA 自合成工件带来的内部供应链威胁，验证了潜伏载荷的跨任务传播能力与防御局限。
提出 SCHEMA，用概念图与轨迹分评测科学 Agent 幻觉
Published Aug 1
Evaluated models Kimi-K2.5 , Qwen3.6-Plus , Llama-4-Scout and others10 Abstract SCHEMA 用知识拓扑评估科学智能体幻觉，终答正确仍可能来自有缺陷的中间推理。SCHEMA 是面向科学智能体幻觉的证据锚定评测框架，实例化在生物医学的 Protein Domain 与 PathVQA-Enhanced。作者在摘要中称它是首个同时做到证据锚定和拓扑感知的此类框架。
提出影子评测，衡量 Agent 自主完成开放式 AI 科研的能力
Published Jul 30
Evaluated models Claude Opus 4.8 , GPT-5.6 Sol , GPT-5.3 Codex Abstract 论文通过影子评测发现前沿智能体能独立胜任科研工程实现，但在科学探索与有效利用反馈上未达到顶会门槛。
提出 BioSecBench-Surveillance，评测智能体的病原监测分析选择
Published Jul 22
Evaluated models Opus 4.8 , Opus 4.7 , Opus 4.6 and others10