Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 254 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 AdvSim2Real,协同训练网页智能体抵御页面注入
Published Oct 7
Evaluated models Qwen3.5-4B 提出 WebFovea,加固视觉网页智能体的解析、执行、反馈与观察往返
Published Oct 2
Evaluated models claude-opus-4-6 提出 CAVEAT 基准,评测激励失配市场中计算机使用 Agent 的购买决策退化
Published Sep 23
Evaluated models GPT-5.6-Sol , GPT-5.6-Terra , GPT-5.6-Luna and others14 Abstract 提出 CAVEAT 基准揭示智能体在商业偏好下的决策退化,诊断出三类失效并给出缓解方案。
评测安全 Agent 在对抗性任务污染下的解题成功与开销
Published Sep 17
Evaluated models Gemma-4 31B , DeepSeek-V4 Flash , GPT-OSS 120B and others6 Abstract AgentLSD 用配对 web CTF 表明,欺骗性环境证据会改变安全智能体的解题率与工作量。AgentLSD 是一个对照框架,用来测量安全智能体在任务本身不变时,对对抗性任务污染的反应。
提出权威链劫持与轨迹引导策略演化,劫持搜索 Agent 的证据链
Published Aug 5
Evaluated models Qwen3.5-9B , Gemma4-31B , DeepResearch and others7 Abstract 论文揭示了多步搜索智能体在受限中间人操纵下的脆弱性,提出 ACH 策略与 TGSE 演化方法并完成系统验证。
用 MisKnow-Agent 评测深度研究智能体是否采纳误导文档结论
Published Jul 23
Evaluated models DeerFlow , WebThinker , Gemini Deep Research and others6 Abstract 论文通过 MisKnow-Agent 框架评估发现长程研究智能体易采纳误导性知识,且现有防御难以完全消除该现象。
对开源视觉购物智能体实施商品图对抗攻击并诱导买错
Published Mar 17
Evaluated models LLaVA-v1.5-7B , Qwen2.5-VL-7B Abstract 作者称 LLaVA 易被三种攻击诱导买错,Qwen 正确购买率仍接近其干净条件。作者在自建电商环境里比较两个开源 VLM 购物智能体对图像对抗扰动的鲁棒性。
测量任务无关说服对 Agent 编码与网页研究行为的影响
Published Feb 1
Evaluated models gpt-4.1-nano , mistral-nemo-12b , llama-3.1-8b Abstract 任务无关说服会在轨迹上留下任务相关的行为痕迹,但立场易感性不能稳定预测其幅度。这篇工作测量一件事:与任务无关的说服进入对话之后,AI 智能体执行后面的编码或网页研究时,轨迹是否系统性不同,以及“更容易被说服”能否预测差有多大。
提出 MalURLBench 评测 Agent 是否接受结构伪装的恶意 URL
Published Jan 26
Evaluated models GPT-3.5-Turbo , GPT-4o-mini , GPT-4o and others13 You have reached the end