Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
All papers Found 30 papers Another 215 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
Measures citation fragility in AI search, demonstrating that ordinary public posts can enter citations and answers.
Published Oct 8
Evaluated models Grok , Doubao , ChatGPT and others10 Abstract The authors claim the paper quantifies vulnerabilities in AI search caused by citation preferences and low posting thresholds; tests show public web posts can penetrate AI citations, and they call for auditing the citation supply chain.
提出热启动 Bandit 的部署前有界离线注入攻击
Published Oct 7
Evaluated models UCB , Thompson Sampling , ϵ-greedy 提出流匹配逆向框架,从多向量视觉文档索引重构页面
Published Oct 7
Evaluated models Tomoro-ColQwen3-8B , ColQwen3.5-4.5B , Tomoro-colqwen3-embed-4b and others13 提出 RAG-PIBench,评测 RAG 上下文中提示注入检测器
Published Oct 6
Evaluated models DistilBERT-base-uncased , DeBERTa-v3-base , MiniLM 提出临时可见性协议,限制持续摄入 RAG 向量库的投毒暴露
Published Oct 5 Abstract 用截止期限制未核验可见时长。这篇工作给持续摄入的 RAG 向量库一个失败关闭的临时可见性协议,把协议能限制的未核验暴露和依赖检测器的中毒暴露分开。
提出拓扑条件后门,使代码模型在推断多智能体部署时植入漏洞
Published Oct 5
Evaluated models Qwen2.5-7B-Instruct , Qwen2.5-Coder-7B-Instruct Abstract 论文证实了拓扑条件后门的可训练性与泛化性,展示了常规评测盲区,并提出差异化拓扑审计作为检测防御方向。
提出 HDI 攻击以篡改 GraphRAG 辅助结构破坏检索
Published Oct 2
Evaluated models Microsoft GraphRAG , HippoRAG2 Abstract 论文形式化了 GraphRAG 辅助模式级实体攻击面,提出 HDI 攻击并验证其攻击效果。
提出 LENS,构造集合级 RAG 语料投毒以导向预设答案
Published Sep 28
Evaluated models Qwen3.6-35B-A3B , Llama-3.1-70B-Instruct , DeepSeek-V4-Pro 提出 Provenance-Aware Transformers,隔离不可信来源防御间接提示注入
Published Sep 18
Evaluated models SmolLM2-360M-Instruct , LLaMA-3-8B-Instruct , Qwen2.5-7B-Instruct and others4 提出基准投毒攻击,使自修改编码 Agent 跨代写出含漏洞代码
Published Sep 16
Evaluated models Claude Sonnet 4.5 , Qwen3.5-397B , gpt-oss-120b and others5 Abstract 论文报告了恶意基准能污染自修改代码智能体的进化过程并持续输出漏洞,警示系统设计需纳入安全约束。
提出神经符号纵深架构,阻断 AI-SOC 的日志投毒与间接提示注入
Published Sep 10
Evaluated models Gemma 3 (12B) Proposes SHAQ, which replaces document embeddings with shadow query embeddings to defend against embedding inversion.
Published Sep 4
Evaluated models GTR-T5 encoder , DPR Abstract SHAQ replaces document embeddings with shadow query embeddings.SHAQ is a defense against EIA for cloud vector databases: instead of directly modifying document embeddings, it replaces them with shadow query embeddings.
提出 CodePoisonRAG,对检索增强代码生成的知识库投毒以植入漏洞
Published Sep 3
Evaluated models Qwen 3.5 9B , Code Llama 13B , DeepSeek-Coder-V2 16B Abstract CodePoisonRAG 展示了 RACG 外部知识库的新攻击面,在较低投毒率下可定向诱发指定漏洞并部分抵御防御。
构建 COUNTER-GEO-BENCH,评测生成式搜索中的 GEO 虚假信息防御
Published Sep 2
Evaluated models Gemma-4-31B-IT , Qwen-3.5-35B-A3B , Llama-4-Scout-17B-16E and others8 Abstract 论文构建了针对 GEO 虚假信息的首个防御基准,揭示通用护栏的失效与反作用,并提出了有效的轻量对比检测基线。
提出 VerTox,用可验证奖励强化学习生成误导文档并投毒检索语料
Published Sep 1
Evaluated models SimLM-base , BGE-base , Cohere-embed-english-v3.0 and others8 Abstract VerTox 以可验证奖励微调小 LLM,生成能抬高排序并腐蚀事实的投毒文档。VerTox 用可验证奖励把小 LLM 微调成语料投毒生成器,用来探测神经排序器在注入文档下的暴露面。
提出 LogInject 框架,评测日志分析中的被动提示注入及缓解
Published Jul 16
Evaluated models GPT-4o , Claude 3.5 Sonnet , Llama-3-70B-Instruct Abstract 论文评估了 LLM 日志分析中的上下文污染风险,提出分片拼接等攻击与三层防御,指出必须结合架构隔离与人工介入。
提出策略 RAG 的知识库投毒攻击与检测防御 CLD-KB
Published Jul 6
Evaluated models Llama 3.2 提出 CRCP 框架,优化分块与重排下的 RAG 语料投毒
Published Jun 9
Evaluated models GPT-4o , DeepSeek-R1 , Qwen3-Max and others11 Abstract CRCP 把投毒做成多阶段一致性问题。CRCP 研究的是带分块和重排的 RAG 语料投毒,而不是只提高文档级检索分数。
提出 DiscourseFlip,用有限文档投毒操纵黑盒 RAG 的话语级观点
Published May 31
Evaluated models Llama3.1-8B-Instruct , Qwen3-8B-Instruct , BGE and others5 Abstract DiscourseFlip 按语义图分配投毒预算。DiscourseFlip 是针对黑盒 RAG 的话语级观点操纵。作者要处理的缺口是:只打单条查询或主题局部查询时,覆盖窄,目标受审查时容易被隔离,也难沿相关话题传播。攻击者不能看检索器或 LLM 内部,也不能改提示词模板,只能在文档数、生成 token 和 SEO 编辑距离限制下注入少量文档。
提出 SilentRetrieval,以语义保持对抗文档投毒劫持 RAG 检索与生成
Published May 27
Evaluated models Llama-2-7B-Chat , Mistral-7B-Instruct-v0.2 , Qwen-7B-Chat and others10 Abstract 两阶段投毒在单文档协议下兼顾检索劫持、生成操纵与近良性困惑度。SilentRetrieval 是针对 RAG 的两阶段语料投毒,在每查询一篇、合成目标答案的统一协议下,同时处理检索劫持、生成操纵和流畅度。