Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
Another 227 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 MADBench，评测多智能体辩论是吸收还是放大对抗影响
Published Sep 30
Evaluated models gpt-4o , GPT-5 , GPT-6 Astra Abstract MADBench 显示辩论能吸收部分准确率攻击，同时放大未授权读写。MADBench 是一个评测多智能体辩论安全性的基准，用来看攻击是被辩论吸收还是被放大。
提出 Pictionary，将不可信文本渲染成图像以防御提示注入
Published Sep 29
Evaluated models Claude Opus 4.7 , Claude Haiku 4.5 , GPT-5.5 and others12 提出 GraphProfiler，用个人知识图谱从帖子历史推断敏感属性并溯源
Published Sep 11 Abstract GraphProfiler 用源链接个人知识图谱做属性推断，准确率接近文本基线，并把证据定位到少量源帖。GraphProfiler 是一个可审计的 LLM 敏感属性画像器：用源链接个人知识图谱，把推断落到具体帖子。
用 MMPIBench 评测多模态提示注入对 Agent 框架的影响
Published Sep 9
Evaluated models Claude Opus 4.8 , GPT-5.4 , Gemini 3.1 Pro and others6 Abstract 论文提出 MMPIBench 评测多模态提示注入对智能体的影响，发现模型主导行为、尝试远超完成，音频通道缺乏防护。
提出 PaperGuard，用图文注入与梯度扰动抬高自动审稿分数并检测恶意指令
Published Jun 11
Evaluated models Claude-sonnet-4.5 , GPT-4o , GPT-4.1 and others11 Abstract PaperGuard 测到提示注入与白盒视觉抬分，并比较分块检索防御。PaperGuard 同时评测并检测多模态 AI 审稿中的评分操纵。
测量 LLM 重排序器对文档内提示注入的脆弱性
Published Feb 18
Evaluated models Qwen3-0.6B , Qwen3-1.7B , Qwen3-8B and others16 Abstract 复现 DOH/DCH 对 LLM 重排序器的影响，并给出规模、位置、架构和领域上的边界。
提出查询无关黑盒攻击 DQ-A，用可迁移文末后缀降低文档检索排名
Published Jan 31
Evaluated models Qwen-1.5-7B-Instruct , SFR-Embedding-Mistral , E5-Mistral-7B-Instruct and others10 Abstract DQ-A 以无查询黑盒后缀压低 LLM 检索排名，并在 BRIGHT 上比较三种基线。DQ-A 是一种 query-agnostic、complete black-box 的文档隐藏攻击，对象是用最后隐层相似度匹配的 LLM 检索。
提出 WAInjectBench 评测网页 Agent 的提示注入检测
Published Oct 2, 2025
Evaluated models GPT-4o , Mistral-7B-Instruct-v0.1 , Llama-Prompt-Guard-2-86M and others8 Abstract WAInjectBench 比较网页智能体的提示注入检测：显式线索可被部分检出，隐蔽攻击大多漏检。WAInjectBench 是网页智能体提示注入检测的基准。作者要看现有检测器能否发现这类攻击：攻击者改网页，使智能体执行目标动作，而不是用户任务。作者称这是首个此类综合基准。
You have reached the end