Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 MMSkillRisk 基准,评测多模态技能图像中的隐藏指令诱导 Agent 越权操作
Published Sep 28
Evaluated models GPT-5.6-sol , Kimi-K2.6 , Kimi-K3 and others6 Abstract 论文提出 MMSkillRisk 基准与 NCVA 攻击,揭示多模态技能中教学图像潜藏指令可引发未授权操作并与良性任务共存。
用词级归因指导同义词替换,翻转提示注入检测并验证越狱
Published Sep 22
Evaluated models Prompt Guard 2 (86M) , Llama 3.1 8B 提出 SinoGlyphBench,用配对字形混淆诊断中文审核稳定性
Published Sep 5
Evaluated models GPT-5.4 mini , GPT-5.5 , DeepSeek V4 Flash and others12 Abstract SinoGlyphBench 显示中文字形混淆会同时增加有害漏报和误报,全文扰动最重。SinoGlyphBench 是一个配对诊断基准,用来看内容审核在可还原的中文字形混淆下是否还保持原决定。
提出 SYNCHAIN,诱导计算机使用 Agent 自建跨任务持久攻击链
Published Aug 7
Evaluated models Qwen3.5-9B , Llama-3.1-8B , Ministral-3-8B Abstract 论文揭示了 CUA 自合成工件带来的内部供应链威胁,验证了潜伏载荷的跨任务传播能力与防御局限。
提出 Vaporizer,用词法变换、翻译和释义破解 LLM 输出水印
Published May 8 提出 PoisonedSkills,评测编码 Agent 技能生态的文档投毒
Published Apr 3
Evaluated models Claude Sonnet 4.6 , GLM-4.7 , MiniMax-M2.5 and others5 Abstract 作者称技能文档可成为系统操作攻击入口,但结果只评估加载后的阶段。PoisonedSkills 研究编码智能体的技能供应链投毒,重点是文档内容如何进入实际系统操作。 。
提出 SkillJect,自动生成投毒 skill 诱导代码 Agent 执行隐藏脚本
Published Feb 16
Evaluated models Claude-4.6-Sonnet , GPT-5-mini , GLM-4.7 and others10 Abstract SkillJect 用双通道和闭环精炼投毒 skill。SkillJect 是针对可安装 agent skill 的自动化提示注入框架。作者要解决的是:公开或手工放入 skill 的恶意指令常常被拒绝或忽略,而 skill 一旦安装就会被反复当作可信指导加载。
Attacks arXiv 2509.09112 · Sep 11, 2025 提出字符级扰动与遗传算法去除 LLM 水印
Published Sep 11, 2025
Evaluated models OPT-1.3B , LLaMA-3-8B Abstract 字符级扰动靠更大攻击范围移除水印。这篇工作评估推理时 LLM 水印在黑盒、有限查询下的移除难度,并比较字符级、token 级和句子级编辑。
You have reached the end