Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 AdvSim2Real,协同训练网页智能体抵御页面注入
Published Oct 7
Evaluated models Qwen3.5-4B 重测提示注入检测器在 Agent 工具输出上的检出与任务阻断
Published Oct 2
Evaluated models Horizon-Labs , Wolf Defender , Prismor-1.5B and others15 Abstract 论文揭示公开基准无法反映智能体检测器表现,检测能力源于输入格式相似而非通用防御,建议基于工具输出与低误报评测。
评测安全 Agent 在对抗性任务污染下的解题成功与开销
Published Sep 17
Evaluated models Gemma-4 31B , DeepSeek-V4 Flash , GPT-OSS 120B and others6 Abstract AgentLSD 用配对 web CTF 表明,欺骗性环境证据会改变安全智能体的解题率与工作量。AgentLSD 是一个对照框架,用来测量安全智能体在任务本身不变时,对对抗性任务污染的反应。
提出 PIDS-Bench,评测提示注入检测器在过度防御与分布偏移下的表现
Published Sep 14
Evaluated models TF-IDF + logistic regression , DistilBERT , DeBERTa-v3-FT and others7 Abstract PIDS-Bench 显示高分布内 F1 仍会过度拦截外部来源的安全相关良性输入。PIDS-Bench 是一个冻结的检测器级基准,用来在固定阈值下同时看提示注入检测和良性误报。
提出 CDH 攻击,让技能型 Agent 绕路放大资源消耗
Published Aug 13
Evaluated models Claude-Haiku-4.5 , DeepSeek-V4-Pro , DeepSeek-V4-Flash and others6 Abstract CDH 让静态技能在保持任务完成时拉高调用与 token,耗时则因后端而异。CDH 是针对渐进披露技能智能体的发布者侧、纯文本攻击:一个静态协调器把本可正确完成的任务,拐进有界但更耗资源的技能绕路,再交还原任务。
提出 Aegis 红队框架,多轮攻击高风险语音 Agent
Published Feb 7
Evaluated models GPT-4o , GPT-4o-mini , Gemini-1.5 Pro and others7 Abstract Aegis 红队评测三类语音智能体:查询式访问消掉认证与泄密成功,行为类攻击仍在。Aegis 用多轮红队评测已接入业务系统的 ALLM 语音智能体。作者称这是该设定下的 the first systematic red-teaming framework。
You have reached the end