Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 248 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出持久视觉记忆注入,使对抗图像经缓存在触发时操控输出
Published Oct 7
Evaluated models Qwen3-8B , Qwen3-VL-8B-Instruct , Gemma-4-12B Abstract 论文提出 P-VMI,证实对抗输入被掩蔽后仍可经 KV 缓存持久控制模型,强调了保留状态的安全风险。
提出 MMSkillRisk 基准,评测多模态技能图像中的隐藏指令诱导 Agent 越权操作
Published Sep 28
Evaluated models GPT-5.6-sol , Kimi-K2.6 , Kimi-K3 and others6 Abstract 论文提出 MMSkillRisk 基准与 NCVA 攻击,揭示多模态技能中教学图像潜藏指令可引发未授权操作并与良性任务共存。
提出跨通道分段攻击,利用 MCP 隐式信任外发敏感文件
Published Sep 16
Evaluated models GPT-4o , GPT-4o-mini , GPT-5.4 and others15 Abstract 论文揭示了 MCP 多通道隐式信任层级,通过跨通道分段与协议级利用突破现有防御,展示了严重的凭证外发风险。
提出 CrossMPI,仅用图像扰动实现跨模态提示注入
Published May 15
Evaluated models MiniGPT4-llama2 , MiniGPT4-vicuna , InstructBLIP and others6 提出 AudioHijack,用不可感知对抗音频对语音模型做上下文无关提示注入
Published Apr 16
Evaluated models SpeechGPT , GLM-4-Voice , VITA-Audio and others15 Abstract 提出了 AudioHijack 框架,揭示了 LALM 对听觉提示注入的脆弱性与传统防御的局限。
提出 CoTTA 隐蔽视觉提示注入,使多模态模型输出指定指令
Published Mar 31
Evaluated models GPT-4o , GPT-5 , Claude-4.5 and others4 Abstract CoTTA 以隐蔽触发和双目标对齐诱导指定句子。
提出 SkillJect,自动生成投毒 skill 诱导代码 Agent 执行隐藏脚本
Published Feb 16
Evaluated models Claude-4.6-Sonnet , GPT-5-mini , GLM-4.7 and others10 Abstract SkillJect 用双通道和闭环精炼投毒 skill。SkillJect 是针对可安装 agent skill 的自动化提示注入框架。作者要解决的是:公开或手工放入 skill 的恶意指令常常被拒绝或忽略,而 skill 一旦安装就会被反复当作可信指导加载。
Attacks arXiv 2509.22040 · Sep 26, 2025 通过规则文件提示注入劫持编码编辑器并执行未授权终端命令
Published Sep 26, 2025
Evaluated models Cursor , GitHub Copilot , Claude 4 Sonnet and others4 Abstract 论文提出了针对代码编辑器的提示注入评估框架 AIShellJack,实验显示攻击能诱导 AI 执行未授权终端命令。
You have reached the end