Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
Another 216 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 CredLeak-Bench,评测 Agent 面对钓鱼的凭据泄露与恢复
Published Oct 6
Evaluated models Claude Sonnet 5 , Claude Opus 4.8 , Gemini 3.6 Flash and others7 提出 PAA 方法,在边界动作前审计长流程智能体的分阶段提示注入
Published Oct 4
Evaluated models Claude Code (v2.1.172, Claude Sonnet 5) , Codex CLI (v0.144.0, GPT-5.5) Abstract 论文针对长流程注入提出边界动作审计与 PAA,在保持低误阻的同时实现高拦截率。本研究针对长流程智能体在执行任务时面临的分阶段间接提示注入威胁,提出了在动作生效前进行拦截的边界动作审计框架与路径对齐归因方法。
构建可组合工具包 pikit,评测编码智能体的间接提示注入
Published Sep 29 Abstract pikit 提供组合式间接注入评测。pikit 是面向间接提示注入研究的组合式工具包 ,主要贡献是组织攻击、投递通道、防御和判定流程,而非提出新的攻击优化算法。
构建 ACE 语料,评测内核级证据对 Agent 攻击检测的有效性
Published Sep 24
Evaluated models AdaBoost , XGBoost , TabPFN and others10 Abstract ACE 用配对的内核与应用层证据表明,syscall 痕迹可判别智能体攻击,两层组合通常更好。ACE 是一份把智能体会话的内核 syscall 痕迹与应用层清单、转录配对起来的检测语料和基准。 。
提出 PMPA,经外部源向 Agent 持久记忆投毒并跨会话泄露隐私
Published Sep 12
Evaluated models DeepSeek-V4-Flash , DeepSeek-V4-Pro , Qwen3-Max Abstract 论文提出了持久记忆投毒攻击 PMPA,报告了 harness 智能体在处理外部数据时易受跨会话记忆投毒与隐私泄露的风险。
提出企业级检测系统 ADR,识别编程 Agent 的提示注入与恶意 MCP
Published May 17 Abstract 提出了端点因果遥测、两级在线分流与离线红队闭环的 ADR 系统,并在生产环境中验证了有效性。
提出 WebTrap 三阶段陷阱,中途劫持浏览器 Agent 完成攻击后再返回用户任务
Published May 8
Evaluated models DeepSeek-V3.1-Terminus , Gemini-2.5-Flash , GLM-4.5-Air and others5 Abstract WebTrap 把攻击目标嵌进用户流程中途执行再返回。WebTrap 是针对长程网页与文件导航的中途劫持注入,目标是在完成攻击动作后仍回到用户任务。
构建 TRAP 基准,评测网页 Agent 被界面提示注入劫持任务的情况
Published Dec 29, 2025
Evaluated models GPT-5 , Claude Sonnet 3.7 , Gemini 2.5 Flash and others6 Abstract 论文提出了基于五维模块化攻击空间的 TRAP 基准,评估了六个模型在真实网页环境中的注入风险。研究定位 :针对网页自主智能体易受外部界面提示注入攻击的问题,构建了基于真实网站克隆的模块化评测基准 TRAP。
提出 WAInjectBench 评测网页 Agent 的提示注入检测
Published Oct 2, 2025
Evaluated models GPT-4o , Mistral-7B-Instruct-v0.1 , Llama-Prompt-Guard-2-86M and others8 Abstract WAInjectBench 比较网页智能体的提示注入检测:显式线索可被部分检出,隐蔽攻击大多漏检。WAInjectBench 是网页智能体提示注入检测的基准。作者要看现有检测器能否发现这类攻击:攻击者改网页,使智能体执行目标动作,而不是用户任务。作者称这是首个此类综合基准。
You have reached the end