Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 281 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
用翻译前缀做跨语言训练数据提取,恢复英语训练文本中的 PII
Published Oct 5
Evaluated models GPT-Neo 1.3B , GPT-Neo 2.7B , GPT-J 6B and others7 Abstract 跨语言 TDE 能恢复英语记忆的 PII,转移随多语训练和措辞保真变化。这篇工作检验训练数据抽取是否跨语言:英语段落里记住的 PII,能否被其他语言的前缀逐字抽出。
提出 PrivDrift 基准,审计话题漂移后的用户秘密复述
Published Sep 25
Evaluated models GPT-OSS-120B , DeepSeek-R1 , Qwen3-VL-235B 利用加密思维块的跨模型重放,诱导弱模型逐字转写专有推理链
Published Aug 11
Evaluated models Claude Opus 4.8 , Claude Sonnet 4.6 , Claude Haiku 4.5 and others13 Abstract 论文揭示了客户端加密思维块跨模型互换漏洞,提出了低成本提取方法并给出防御方案。
用编码与结构化请求抽取系统指令,并用 CoT 改写加固
Published Apr 1
Evaluated models GPT-4.1-mini , GPT-3.5-turbo , Gemini-2.5-flash and others7 Abstract 编码式请求可在直接拒答后引出系统指令。这项工作评测并加固 LLM 系统指令在编码式抽取下的保密性。作者关心的是:直接抽取已被拒绝时,把同一请求改写成格式化或编码任务,模型是否仍交出受保护内容。
提出用户侧防御 TRACE-RPS,分享前匿名化文本并追加后缀以抑制属性推断
Published Feb 12
Evaluated models Llama2-7B-Chat , Llama2-13B-Chat , Llama3.1-8B-Instruct and others10 Abstract 用户侧 TRACE 加 RPS/MPS,在分享前降低 LLM 对敏感属性的推断准确率。这是一项用户侧防御:在文本公开前降低 LLM 对敏感属性的推断,而不是改攻击提示或削弱模型推理。
提出 JustAsk,用在线技能选择提取模型系统提示词
Published Jan 29
Evaluated models anthropic/claude-opus-4.5 , openai/gpt-5.2-codex , GPT-5.2 and others19 Attacks arXiv 2512.16059 · Dec 18, 2025 提出 ContextLeak,用金丝雀成员推断审计私有 ICL 泄漏
Published Dec 18, 2025
Evaluated models Llama3.3-70b , Qwen2.5-72b , GPT-4.1 and others6 Abstract ContextLeak 审计私有 ICL 的 worst-case 泄漏。ContextLeak 是一套用成员推断审计私有 ICL 的框架,目标是给 worst-case 泄漏一个经验下界,而不是只引用理论 ε。
Attacks arXiv 2509.09488 · Sep 11, 2025 提出 SeedSnitch 与 PromptPirate,恢复种子后窃取扩散提示词
Published Sep 11, 2025
Evaluated models Stable Diffusion 3.5 Large , Stable Diffusion 3.5 Medium , Stable Diffusion 3.5 Turbo and others4 You have reached the end