Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 13 papers Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
TAPDreamer 用公开编码器做固定补丁。
Published Oct 6
Evaluated models FastWAM , DreamWAM-uncond , DreamWAM-joint and others4 提出 ENDOPROMPT，以受害者侧伪参考学习降低良性任务效用的前缀
Published Sep 24
Evaluated models Qwen2.5-7B , Llama-3.1-8B , Mistral-7B-v0.3 and others4 Abstract 作者用受害模型续写监督良性效用攻击，并把行为位移、任务退化与请求匹配效果分开评测。ENDOPROMPT 是一种用受害模型自身续写监督前缀生成的 white-box 效用攻击方法。 它针对良性任务失败，不要求产生有害内容或明确拒答。
定义工具调用 Agent 的持久计费状态，提出拒绝钱包攻击与防御
Published Sep 23
Evaluated models GPT-4o , GPT-4o-mini , Mistral-Large and others7 Abstract 已准入工具返回的跨轮保留会重复计费。这篇工作把工具调用智能体里跨轮保留、并被提供商反复计费的外部工具返回定义为 persistent billable state，并把它的主机侧再次送入决定当作控制点。 。
提出 SKILLBLOAT，改写技能文档放大编码 Agent token 消耗
Published Aug 22
Evaluated models GLM-4.7-Flash , GLM-5 , GPT-5.4 Mini and others4 提出 CDH 攻击，让技能型 Agent 绕路放大资源消耗
Published Aug 13
Evaluated models Claude-Haiku-4.5 , DeepSeek-V4-Pro , DeepSeek-V4-Flash and others6 Abstract CDH 让静态技能在保持任务完成时拉高调用与 token，耗时则因后端而异。CDH 是针对渐进披露技能智能体的发布者侧、纯文本攻击：一个静态协调器把本可正确完成的任务，拐进有界但更耗资源的技能绕路，再交还原任务。
提出 RolePlay 框架，用人设条件放大 LLM 单次推理开销
Published Jul 29
Evaluated models DeepSeek-V4-Pro , Gemini-3.5-Flash , Qwen-3.5-Plus and others5 提出针对 Agent 护栏的推理扩展拒绝服务攻击
Published Jun 12
Evaluated models TS-Guard-8B , Qwen3.5-9B , DeepSeek-V3.2 and others11 提出层级遗传算法 HGA，扰动题目逻辑结构诱发推理模型过度思考
Published May 13
Evaluated models DeepSeek-R1 (671B) , Qwen3-Thinking , GPT-o3 and others5 Abstract HGA 在黑盒推理模型上用逻辑扰动拉长输出，作者称可从小代理迁移，查询成本是其局限。
Proposes DAERT, which uses simulated failures as reward to generate diverse adversarial instructions, exposing VLA language vulnerabilities.
Published Apr 7
Evaluated models π0 , OpenVLA , OpenVLA-7B and others5 Propose SABER, which uses a reinforcement learning attacker to rewrite instructions within a budget to cause VLA task failure.
Published Mar 26
Evaluated models π0-LIBERO , π0.5 , X-VLA and others6 Propose Clawdrain, amplifying OpenClaw's token consumption with a trojan skill
Published Mar 1
Evaluated models Gemini 2.5 Pro 提出 Aegis 红队框架，多轮攻击高风险语音 Agent
Published Feb 7
Evaluated models GPT-4o , GPT-4o-mini , Gemini-1.5 Pro and others7 Abstract Aegis red-teams three types of voice agents: query-based access eliminates authentication and leakage successes, but behavioral attacks remain.Aegis uses multi-turn red-teaming evaluation on ALLM voice agents already integrated into business systems. The authors call this the first systematic red-teaming framework in this setting.
Attacks arXiv 2505.23266 · May 29, 2025 提出 AdvOF，生成对抗物体误导视觉语言导航智能体的场景感知
Published May 29, 2025
Evaluated models Lseg , Clip , ViT-L/16 and others5 Abstract AdvOF 以多视角融合生成对抗物体。AdvOF 是针对 VLM 驱动 VLN 服务导航的对抗物体攻击。
You have reached the end