Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 261 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 EviLLM,经账户指令或插件向代码生成流程注入漏洞
Published Oct 3
Evaluated models GPT-4o , Llama 3.2 (3B) 提出 LiBRA,在潜空间双向优化以规避图像水印双侧检测
Published Oct 2
Evaluated models Stable Signature , YU1 , HiDDeN and others4 Abstract LiBRA 用双向潜空间优化规避双侧水印检测,并提高相对反转基线的保真。
提出检索器后门攻击操纵智能体搜索,并用 DOU 逃避检测
Published Sep 26
Evaluated models E5 , Contriever-MSMARCO Abstract 论文展示了通过恶意检索器操纵智能体多轮搜索并利用诱饵重塑表征隐蔽后门的可行性与系统风险。
提出技能级联攻击,把有害目标拆散到多个技能里绕过单技能扫描
Published Sep 25
Evaluated models GPT-5.4 , GPT-5.4 Mini , Claude Opus 4.6 and others11 Abstract 论文探讨了多技能智能体系统面临的技能级联攻击风险,提出自动化红队框架与基准集,指出跨技能交互存在安全防护盲区。
复现 Tree-Ring 语义水印的黑盒伪造并恢复检测统计量
Published Sep 11
Evaluated models Stable Diffusion XL base 1.0 提出黑盒攻击 DRIFT,偏转生成轨迹以去除扩散水印
Published Sep 8 提出 MAFIA,以探测放置与事实伪装对带审计 Agent 做查询式记忆投毒
Published Aug 4
Evaluated models gpt-5.4-mini , Gemini , ProtectAI and others8 提出 TIP,用树搜索为 MCP 响应生成隐蔽注入载荷
Published Mar 25
Evaluated models Qwen2.5-7B-Instruct , Qwen2.5-72B-Instruct , Llama3.1-8B-Instruct and others8 Abstract TIP 在 MCP 工具响应上做黑盒注入。TIP 是面向 MCP 工具响应的 black-box 间接提示注入,目标是在不改工具元数据的情况下生成语义连贯的 JSON 载荷。
提出 TFA 与 SVA,抑制 ensemble 后门指纹验证
Published Jan 7
Evaluated models LLaMA2-7B , LLaMA3.1-8B-It , Qwen2.5-7B and others11 Abstract 两种 ensemble 攻击 TFA/SVA 抑制后门指纹。TFA 与 SVA 是针对后门式 LLM 指纹的 ensemble 抑制攻击,不改模型参数。所有者用 SFT 写入秘密对,只通过 API 验证版权。攻击者未授权取得模型,不知道触发和指纹,却要把每个模型的验证变成失败,同时让 ensemble 至少不差于性能最高的单模型。
You have reached the end