Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
Another 215 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 CredLeak-Bench,评测 Agent 面对钓鱼的凭据泄露与恢复
Published Oct 6
Evaluated models Claude Sonnet 5 , Claude Opus 4.8 , Gemini 3.6 Flash and others7 构建可组合工具包 pikit,评测编码智能体的间接提示注入
Published Sep 29 Abstract pikit 提供组合式间接注入评测。pikit 是面向间接提示注入研究的组合式工具包 ,主要贡献是组织攻击、投递通道、防御和判定流程,而非提出新的攻击优化算法。
构建 ACE 语料,评测内核级证据对 Agent 攻击检测的有效性
Published Sep 24
Evaluated models AdaBoost , XGBoost , TabPFN and others10 Abstract ACE 用配对的内核与应用层证据表明,syscall 痕迹可判别智能体攻击,两层组合通常更好。ACE 是一份把智能体会话的内核 syscall 痕迹与应用层清单、转录配对起来的检测语料和基准。 。
提出 EXE-Bench 比较 Windows 恶意软件检测器的可用性权衡
Published Jul 27
Evaluated models EmberGBDT , BBDnn , BBDnnFDRS and others15 Abstract 统一四指标后,手工特征的 EmberGBDT 综合居首,只看准确率会误导部署。EXE-Bench 用同一设置给 AI Windows 恶意软件检测器做四指标排序,而不是只比一次测试集准确率。 。
提出企业级检测系统 ADR,识别编程 Agent 的提示注入与恶意 MCP
Published May 17 Abstract 提出了端点因果遥测、两级在线分流与离线红队闭环的 ADR 系统,并在生产环境中验证了有效性。
提出 LODO 评测恶意提示探针的跨数据集泛化
Published Feb 15
Evaluated models Llama-3.1-8B-Instruct , Gemma-3-27B , Qwen-3.5-4B and others5 Abstract 作者称 LODO 露出 CV 高估,数据集身份与安全方向部分重叠,标准域泛化干预关不上。LODO 用来检查恶意提示词分类器换成没见过的数据集后,还剩多少检测能力。 。
构建 TRAP 基准,评测网页 Agent 被界面提示注入劫持任务的情况
Published Dec 29, 2025
Evaluated models GPT-5 , Claude Sonnet 3.7 , Gemini 2.5 Flash and others6 Abstract 论文提出了基于五维模块化攻击空间的 TRAP 基准,评估了六个模型在真实网页环境中的注入风险。研究定位 :针对网页自主智能体易受外部界面提示注入攻击的问题,构建了基于真实网站克隆的模块化评测基准 TRAP。
提出 WAInjectBench 评测网页 Agent 的提示注入检测
Published Oct 2, 2025
Evaluated models GPT-4o , Mistral-7B-Instruct-v0.1 , Llama-Prompt-Guard-2-86M and others8 Abstract WAInjectBench 比较网页智能体的提示注入检测:显式线索可被部分检出,隐蔽攻击大多漏检。WAInjectBench 是网页智能体提示注入检测的基准。作者要看现有检测器能否发现这类攻击:攻击者改网页,使智能体执行目标动作,而不是用户任务。作者称这是首个此类综合基准。
You have reached the end