Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
Another 201 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
评估应用决策层的输入注入与隐私推断风险
Published Oct 4
Evaluated models Jev , NanoJev Abstract Jev 的类型化决策可被输入与训练操纵,也会泄露信息,并同时支持检测与滥用。Jev 是 TypeSafe 的 System One 模型,把应用 state 和固定问题变成 Choice、Noul 或 Score 的类型化决策与概率。作者用官方 API 和可改训练的 NanoJev,考察它作为决策层时的操纵、泄露与双重用途。
提出 BLINDBIAS,通过纯文本续写与前缀控制越狱黑盒模型
Published Sep 29
Evaluated models GLM-5 , Gemini-3.5-Flash , Qwen3-32B and others4 Abstract 作者认为,隐藏数值概率并不足以消除支持重复采样和前缀续写的解码攻击面。BLINDBIAS 是一种针对 sample-only 续写接口的 black-box 解码时越狱框架 ,研究没有目标数值概率时,采样能否支持逐步控制。
提出推理通道预填与输出前缀组合攻击以越狱推理模型
Published Sep 24
Evaluated models Gemini 3 Flash Preview , DeepSeek V4 Flash , Claude Haiku 4.5 检验结构越狱 IICL 能否跨厂商泛化并与语言约束叠加
Published Sep 8
Evaluated models gemini-2.5-flash , gemini-2.5-flash-lite 利用加密思维块的跨模型重放,诱导弱模型逐字转写专有推理链
Published Aug 11
Evaluated models Claude Opus 4.8 , Claude Sonnet 4.6 , Claude Haiku 4.5 and others13 Abstract 论文揭示了客户端加密思维块跨模型互换漏洞,提出了低成本提取方法并给出防御方案。
提出 SMT 框架,用模拟审核轨迹越狱函数调用 LLM
Published Jul 1
Evaluated models GPT-4o , GPT-5.4 , Qwen3-Max and others7 Attacks arXiv 2510.10271 · Oct 12, 2025 提出 MetaBreak,用特殊 token 操纵越狱在线 LLM 服务并绕过审核
Published Oct 12, 2025
Evaluated models Llama-3.3-70B-Instruct , Qwen-2.5-72B-Instruct , Gemma-2-27B-Instruct and others10 Abstract 利用特殊 token 注入对抗平台模板包裹与审核,多场景验证了越狱有效性与互补性。
Attacks arXiv 2509.25624 · Sep 30, 2025 提出 STAC 框架,把恶意目标拆成多轮看似无害的工具调用链
Published Sep 30, 2025
Evaluated models GPT-4.1-2025-04-14 , GPT-4.1-mini-2025-04-14 , Qwen3-32B and others8 Abstract 作者提出并验证了智能体在序列化工具攻击下的普遍脆弱性,指出针对累积动作序列防御的必要性。
Attacks arXiv 2505.12287 · May 18, 2025 提出四段越狱提示,评测中英提示对闭源模型的绕过效果
Published May 18, 2025
Evaluated models GPT-4o , DeepSeek-R1 , Gemini-1.5-Pro and others4 You have reached the end