Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出回答端后门，让模型自生成触发词以在干净有害请求下绕过拒答
Published Oct 6
Evaluated models Llama-2-7B-chat-hf , Mistral-7B-Instruct-v0.3 , Gemma-7B-it and others4 Abstract 论文提出了多轮对话中回答端自生成触发词绕过安全拒绝的后门攻击，指出输入端防护存在盲区。
提出 ReSA，从对齐模型行为恢复安全奖励并在解码时反转
Published Oct 6
Evaluated models Llama3.1-8B-Instruct , Gemma-7B-Instruct , Qwen2.5-7B-Instruct and others9 Abstract ReSA 用最大熵 IRL 从对齐模型行为恢复代理安全奖励，并在解码时反转以诱导有害输出。ReSA 是一种对抗攻击：从对齐模型的可观察行为恢复代理安全奖励，再在解码时把该奖励反过来用。 。
提出 OTTER 词元替换越狱，绕过表面毒性审核诱导有害回答
Published Jun 19
Evaluated models gpt-4-turbo , gpt-4o , gpt-4o-mini and others4 Abstract 论文展示了表面毒性与恶意意图的解耦现象，通过标准 API 实现黑盒越狱测试，并提出闭环分类器加固建议。
提出纯视觉越狱攻击 VJA，把有害编辑指令编码进图像
Published Feb 11
Evaluated models Nano Banana Pro , GPT Image 1.5 , Qwen-Image-Edit and others9 提出 SpatialJB，用二维版式打散有害输出以绕过输出护栏
Published Jan 14
Evaluated models GPT-4 , DeepSeek-R1 , DeepSeek-V3 and others11 Attacks arXiv 2510.10271 · Oct 12, 2025 提出 MetaBreak，用特殊 token 操纵越狱在线 LLM 服务并绕过审核
Published Oct 12, 2025
Evaluated models Llama-3.3-70B-Instruct , Qwen-2.5-72B-Instruct , Gemma-2-27B-Instruct and others10 Abstract 利用特殊 token 注入对抗平台模板包裹与审核，多场景验证了越狱有效性与互补性。
Attacks arXiv 2510.02833 · Oct 3, 2025 提出两阶段良性微调攻击，经 FaaS 用良性数据解除安全对齐
Published Oct 3, 2025
Evaluated models Llama2-7b-chat-hf , Llama3-8b-instruct , Deepseek-R1-Distill-Llama3-8b and others10 You have reached the end