Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 11 papers Another 240 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出用 API 推理摘要重建轨迹再蒸馏加强化学习,攻破蒸馏防御
Published Sep 29
Evaluated models Qwen2.5-0.5B , Qwen2.5-1.5B , Qwen2.5-3B and others12 Abstract 更现实的蒸馏攻击是蒸馏后再 RL。这篇工作修订蒸馏攻击的威胁模型:攻击者经合法 API 收集闭源推理数据,先蒸馏自有模型,再做强化学习。作者认为只在蒸馏后评估防御,会漏掉后续 RL,从而高估防御。
提出推理通道预填与输出前缀组合攻击以越狱推理模型
Published Sep 24
Evaluated models Gemini 3 Flash Preview , DeepSeek V4 Flash , Claude Haiku 4.5 提出任意字母置换密码越狱,无需微调即可诱导有害输出
Published Sep 9
Evaluated models Claude Sonnet 4 , Claude Sonnet 4.5 , Gemini 3 Flash (preview) and others7 Abstract 前沿大模型无需微调即可通过提示词学会字母置换密码,进而绕过分类器与对齐,作者呼吁关注能力提升带来的安全风险。
提出 SPARED,用对抗编辑数据训练基于推理的 AI 生成图像检测器
Published Aug 13
Evaluated models Qwen3.5-9B Abstract SPARED 用防捷径的编辑对抗环训练 9B 推理检测器。SPARED 是一套用于可解释 AI 生成图像检测的攻防强化学习流程,报告模型是 Qwen3.5-9B 上的第三轮防御器。
利用加密思维块的跨模型重放,诱导弱模型逐字转写专有推理链
Published Aug 11
Evaluated models Claude Opus 4.8 , Claude Sonnet 4.6 , Claude Haiku 4.5 and others13 Abstract 论文揭示了客户端加密思维块跨模型互换漏洞,提出了低成本提取方法并给出防御方案。
提出 RolePlay 框架,用人设条件放大 LLM 单次推理开销
Published Jul 29
Evaluated models DeepSeek-V4-Pro , Gemini-3.5-Flash , Qwen-3.5-Plus and others5 提出层级遗传算法 HGA,扰动题目逻辑结构诱发推理模型过度思考
Published May 13
Evaluated models DeepSeek-R1 (671B) , Qwen3-Thinking , GPT-o3 and others5 Abstract HGA 在黑盒推理模型上用逻辑扰动拉长输出,作者称可从小代理迁移,查询成本是其局限。
提出 VROP,把有害意图拆成良性视觉 gadget 越狱视觉语言模型
Published Mar 10
Evaluated models GPT-4o , Claude 3.7 Sonnet , GLM-4V-Plus and others7 Abstract VROP 以良性视觉 gadget 与控制流提示词做组合越狱。VROP 是 black-box 多模态越狱框架:不在输入中放显式恶意触发,而把有害目标拆成语义正交的良性视觉 gadget,再用控制流提示词把合成留到后期推理。
提出 Zero2Text,无需训练地跨域反演文本嵌入
Published Feb 2
Evaluated models GTR-Base , Qwen3-Embedding-0.6B , Text-Embedding-3-small and others4 Abstract 零训练在线对齐可在未知域、无泄漏对时从黑盒 embedding 还原句子。Zero2Text 是一种不训练 decoder、也不使用泄漏文本–向量对的文本 embedding 反演,针对 RAG 向量库在严格黑盒、目标域未知时的还原。
Attacks arXiv 2512.05853 · Dec 6, 2025 提出视觉推理序列攻击 VRSA,以图像序列越狱多模态大模型
Published Dec 6, 2025
Evaluated models DeepSeek-VL2-tiny , InternVL-3.5-8B , LLaVA-1.6-Mistral-7B and others8 Attacks arXiv 2510.11570 · Oct 14, 2025 提出四种阶段转换攻击,绕过推理模型的安全推理护栏
Published Oct 14, 2025
Evaluated models gpt-oss-20b , gpt-oss-120b , Qwen3-4B-Thinking-2507 and others10 You have reached the end