Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 22 papers Another 232 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出利用路由元数据推断敏感话题的侧信道攻击
Published Oct 7
Evaluated models RouteLLM (BERT router) , notdiamond-0001 , Vela (vLLM Semantic Router) Abstract 论文揭示并测量了 LLM 路由决策在无文本日志中的敏感话题泄露,验证了按类别公平性防御的有效性与边界。
提出流匹配逆向框架,从多向量视觉文档索引重构页面
Published Oct 7
Evaluated models Tomoro-ColQwen3-8B , ColQwen3.5-4.5B , Tomoro-colqwen3-embed-4b and others13 提出 imMRAG 攻击,从多模态 RAG 私有图像库提取内容
Published Oct 1
Evaluated models Lumina-mGPT , Gemini 2.5 Flash Image Preview , CLIP ViT-B/16 and others5 提出 RECAST,本地改写图表与语音并做可逆数值映射以保护远程推理隐私
Published Oct 1 提出 A2A-TIBA,经 A2A 对等任务间接注入并植入常驻回调
Published Sep 30
Evaluated models MiniMax-M3 , deepseek-v4-pro , glm-5.3 and others8 Abstract A2A-TIBA 一次植入后绕过智能体,GDA 用四类结果定位防线,ELA-ITL 把信封标注列为第三层。A2A-TIBA 把间接提示注入和绕过放进 A2A:gray-box 攻击者已能投递任务,诱导目标部署常驻回调程序后,下令和外传不再经过智能体。
提出 FlowReview,用授权配对与确定性提交门控控制多智能体组合信息流
Published Sep 30
Evaluated models Sonnet 4.5 , Haiku 4.5 , Qwen3-32B and others5 Abstract 配对标准要求拒绝禁止使用并完成授权使用,FlowReview 把三项审查接到执行。这篇工作把多智能体安全写成一件必须同时成立的事:拦住组合信息所启用的禁止使用,并完成同一场景里任务所需的授权使用。
提出 PILLAR,用私有词法预筛与客户端重排保护 RAG 查询
Published Sep 29 Abstract PILLAR 用固定模式的私有 BM25 预筛加本地嵌入重排,在两基准上换取延迟或质量。PILLAR 是面向公开语料的隐私 RAG:半诚实服务器学不到查询词项和访问模式,客户端仍拿到用于增强生成的 k 篇文档。
展示智能体在禁止泄露与独立监视下自发建立隐蔽信道传递机密
Published Sep 26
Evaluated models GPT-5.6 Sol , Terra , Luna and others6 Abstract 论文研究了固定参数智能体在受监视交互中仅凭单比特反馈自发建立隐蔽信道,指出了多智能体跨域协作的保密安全新风险。论文研究了固定参数与提示词的智能体在受审计交互中自发形成隐蔽信道并泄露机密的过程。
提出身份绑定且委托只衰减的能力令牌,用上下文外钱包约束智能体
Published Sep 25 Abstract 用只衰减的身份绑定令牌和上下文外钱包,约束代表人类行动的分布式智能体。代表人类行动的分布式智能体,需要一种不把密钥放进语言模型上下文的授权方式。
提出 CIG-MIA,用上下文信息增益推断 RAG 知识库成员身份
Published Sep 14
Evaluated models Llama-3.1-8B-Instruct , Mistral-7B-Instruct-v0.3 , Llama-2-13b-chat-hf and others6 Abstract CIG-MIA 用注入前后的答案似然差推断 RAG 库成员,灰盒可分性高于所列基线。CIG-MIA 是针对 RAG 外部知识库的成员推断攻击,同时覆盖灰盒和纯文本黑盒。
提出 GraphProfiler,用个人知识图谱从帖子历史推断敏感属性并溯源
Published Sep 11 Abstract GraphProfiler 用源链接个人知识图谱做属性推断,准确率接近文本基线,并把证据定位到少量源帖。GraphProfiler 是一个可审计的 LLM 敏感属性画像器:用源链接个人知识图谱,把推断落到具体帖子。
提出意图驱动本地框架 Veilmind,净化发往远程模型的提示词
Published Sep 10
Evaluated models Veilmind-4B Abstract 本地模型按意图净化提示词,在 Uprise 上给出两个隐私-效用工作点。本地侧的意图驱动净化,用来降低用户提示词发往不受信任远程模型时的敏感属性暴露。
Proposes SHAQ, which replaces document embeddings with shadow query embeddings to defend against embedding inversion.
Published Sep 4
Evaluated models GTR-T5 encoder , DPR Abstract SHAQ replaces document embeddings with shadow query embeddings.SHAQ is a defense against EIA for cloud vector databases: instead of directly modifying document embeddings, it replaces them with shadow query embeddings.
Proposes LeakageBench to evaluate page-level leakage of PII redaction in document images
Published Sep 2
Evaluated models Amazon Comprehend PII , GPT-5.5 , NVIDIA GLiNER PII and others13 提出 Skill-as-API,隔离多智能体协作中的 skill 正文与系统提示词
Published Sep 1 Abstract 协议把 skill 正文留在所有者侧,四层限制发现内容、权限期限和注入拼接。Skill-as-API 是面向智能体软件工程的协调协议,用来在跨组织调用时把 skill 的代码和系统提示词留在所有者进程。作者针对三条威胁:经通道或命名空间抽取专有方法,用注入让被调用模型输出系统提示词,以及协作结束后权限继续保留。
提出 Proof Gateway,用零知识谓词证明实现 Agent 间数据最小化
Published Aug 31 Abstract 作者将 source integrity 而不是证明开销视为绑定约束。Proof Gateway 是一套已运行的智能体间数据最小化机制:用治理谓词的零知识证明代替原始值和自然语言自述。
提出 LeakGauge,用行为后缀的 prefill 对数概率检测上下文泄露
Published Aug 18
Evaluated models Gemma-4-E4B-it , Gemma-4-31B-it , Qwen2.5-14B-Instruct and others11 提出嵌入推断攻击 EIA,在黑盒 IR 中识别所用嵌入模型
Published Jul 1
Evaluated models e5-small , e5-small-v2 , e5-base and others19 Abstract EIA 用无序文档集的差异从候选中识别嵌入模型,并给出 reranker 与阈值下的计数。EIA 是在黑盒 IR 上识别所用嵌入模型的攻击。 。
Propose soft prompt defense AREA, re-anchoring attention to mitigate system prompt leakage
Published Jun 17
Evaluated models Llama-2-7B-chat-hf , Llama-3.1-8B-Instruct , Mistral-7B-Instruct-v0.3 and others8 Abstract The authors measure commercial prompt leakage, propose attention drift, and use AREA to strike a trade-off between usability and leakage resistance.The authors study system prompt leakage in real LLM applications and propose AREA, a mitigation method that does not modify weights.
提出 MEntA,用非模板查询推断文档是否属于 RAG 检索库
Published May 23
Evaluated models Phi4-14B , Llama3.1-8B , CommandR-7B and others5