Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 14 papers Another 261 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出流匹配逆向框架,从多向量视觉文档索引重构页面
Published Oct 7
Evaluated models Tomoro-ColQwen3-8B , ColQwen3.5-4.5B , Tomoro-colqwen3-embed-4b and others13 提出 imMRAG 攻击,从多模态 RAG 私有图像库提取内容
Published Oct 1
Evaluated models Lumina-mGPT , Gemini 2.5 Flash Image Preview , CLIP ViT-B/16 and others5 提出检索器后门攻击操纵智能体搜索,并用 DOU 逃避检测
Published Sep 26
Evaluated models E5 , Contriever-MSMARCO Abstract 论文展示了通过恶意检索器操纵智能体多轮搜索并利用诱饵重塑表征隐蔽后门的可行性与系统风险。
提出 CIG-MIA,用上下文信息增益推断 RAG 知识库成员身份
Published Sep 14
Evaluated models Llama-3.1-8B-Instruct , Mistral-7B-Instruct-v0.3 , Llama-2-13b-chat-hf and others6 Abstract CIG-MIA 用注入前后的答案似然差推断 RAG 库成员,灰盒可分性高于所列基线。CIG-MIA 是针对 RAG 外部知识库的成员推断攻击,同时覆盖灰盒和纯文本黑盒。
提出 PMA,用流形对齐从 E2EO 混淆向量恢复明文
Published Sep 7
Evaluated models BERT-base , RoBERTa-base , T5-base and others6 Proposes SHAQ, which replaces document embeddings with shadow query embeddings to defend against embedding inversion.
Published Sep 4
Evaluated models GTR-T5 encoder , DPR Abstract SHAQ replaces document embeddings with shadow query embeddings.SHAQ is a defense against EIA for cloud vector databases: instead of directly modifying document embeddings, it replaces them with shadow query embeddings.
提出 LeakGauge,用行为后缀的 prefill 对数概率检测上下文泄露
Published Aug 18
Evaluated models Gemma-4-E4B-it , Gemma-4-31B-it , Qwen2.5-14B-Instruct and others11 提出 GeoDetect 以几何分数检测视觉语言预训练模型的对抗样本
Published Jul 16
Evaluated models CLIPViT (ViT-B/16) , CLIPCNN (ResNet-50) , ALBEF and others4 Abstract GeoDetect 用几何分数检测 VLP 对抗样本。GeoDetect 是面向视觉-语言预训练模型的对抗样本检测方法,用嵌入几何而不是任务 logits 区分干净样本与对抗样本。
提出 SeTox 检索增强框架,检测中文新词的隐性毒性
Published Jul 5
Evaluated models SeTox-Qwen2.5-7B Abstract SeTox 用检索把公共共识接入静态 LLM,以检测中文毒性新词。SeTox 研究中文新词上的隐性毒性检测:词表加检索增强,使静态 LLM 在不重训练的情况下利用公开网页上下文。
提出嵌入推断攻击 EIA,在黑盒 IR 中识别所用嵌入模型
Published Jul 1
Evaluated models e5-small , e5-small-v2 , e5-base and others19 Abstract EIA 用无序文档集的差异从候选中识别嵌入模型,并给出 reranker 与阈值下的计数。EIA 是在黑盒 IR 上识别所用嵌入模型的攻击。 。
提出 MEntA,用非模板查询推断文档是否属于 RAG 检索库
Published May 23
Evaluated models Phi4-14B , Llama3.1-8B , CommandR-7B and others5 提出零知识审计协议,核验多租户 RAG 的合谋差分隐私
Published May 19 Abstract 揭示多租户 RAG 合谋泄露按根号 k 放大,提出带零知识证明的无泄露审计协议。论文针对多租户 RAG 服务在多账户协同攻击下隐私边界失效的问题展开研究。
提出 Zero2Text,无需训练地跨域反演文本嵌入
Published Feb 2
Evaluated models GTR-Base , Qwen3-Embedding-0.6B , Text-Embedding-3-small and others4 Abstract 零训练在线对齐可在未知域、无泄漏对时从黑盒 embedding 还原句子。Zero2Text 是一种不训练 decoder、也不使用泄漏文本–向量对的文本 embedding 反演,针对 RAG 向量库在严格黑盒、目标域未知时的还原。
提出 DECEIVE-AFC,以声明改写诱导搜索增强事实核查误判
Published Jan 31
Evaluated models HiSS , LEMMA , DEFAME and others4 You have reached the end