Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
All papers Found 32 papers Another 211 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 BLINDBIAS,通过纯文本续写与前缀控制越狱黑盒模型
Published Sep 29
Evaluated models GLM-5 , Gemini-3.5-Flash , Qwen3-32B and others4 Abstract 作者认为,隐藏数值概率并不足以消除支持重复采样和前缀续写的解码攻击面。BLINDBIAS 是一种针对 sample-only 续写接口的 black-box 解码时越狱框架 ,研究没有目标数值概率时,采样能否支持逐步控制。
提出推理通道预填与输出前缀组合攻击以越狱推理模型
Published Sep 24
Evaluated models Gemini 3 Flash Preview , DeepSeek V4 Flash , Claude Haiku 4.5 提出任意字母置换密码越狱,无需微调即可诱导有害输出
Published Sep 9
Evaluated models Claude Sonnet 4 , Claude Sonnet 4.5 , Gemini 3 Flash (preview) and others7 Abstract 前沿大模型无需微调即可通过提示词学会字母置换密码,进而绕过分类器与对齐,作者呼吁关注能力提升带来的安全风险。
检验结构越狱 IICL 能否跨厂商泛化并与语言约束叠加
Published Sep 8
Evaluated models gemini-2.5-flash , gemini-2.5-flash-lite 揭示推理加深引发的对齐坍塌,用 Reasoning Trap 放大越狱
Published Sep 8
Evaluated models Qwen3-8B , Qwen3-14B , Llama2-7B and others8 Abstract 更深推理提升题目准确率,同时提高扰动下的相对损失。作者研究扩展推理是否以对齐稳健性为代价,提出 ALR、RT 与 RRA。 。
提出广度优先后缀搜索 BOSS,改进 GCG 越狱优化
Published Sep 2
Evaluated models Llama-2-7B-Chat , Yi-1.5-9B-Chat , Qwen2-7B-Instruct and others8 Abstract BOSS 把 GCG 类优化从单条深搜索改为多条短轨迹加源侧诊断。BOSS 是插在 GCG 类离散 suffix 优化上的搜索框架:局部梯度更新不变,变的是固定预算花在深度还是广度。
提出 DIVA,利用跨步条件传播对离散扩散视觉语言模型实施视觉越狱
Published Sep 2
Evaluated models LLaDA-V , MMaDA , LLaDA2.0-Uni 提出 SN-Guided Diffusion,利用安全神经元实现离线越狱
Published Aug 8
Evaluated models Qwen2.5-7B-Instruct , LLaDA-8B-Instruct , Dream-Instruct-7B and others15 Abstract 论文揭示了扩散语言模型对自回归安全神经元的继承性,并提出纯离线黑盒越狱框架 SN-Guided Diffusion。论文系统评估了扩散大语言模型(DLLM)在安全对齐中的双重角色——既作为白盒攻击目标,又作为黑盒越狱生成的对抗工具。
提出 Concept2Scenario,借助内部概念归因发现可迁移的越狱场景
Published Jul 26
Evaluated models Qwen3.5-9B , Llama-3.1-8B , Ministral-3-8B and others6 Abstract 该研究从表征空间因果归因揭示场景削弱拒绝的机制,发现可复用脆弱场景先验,提升多模型黑盒越狱效能与探索速度。
提出 SMT 框架,用模拟审核轨迹越狱函数调用 LLM
Published Jul 1
Evaluated models GPT-4o , GPT-5.4 , Qwen3-Max and others7 提出 SlotGCG,按注意力选槽插入对抗 token 以越狱指令模型
Published Jun 4
Evaluated models LLAMA2-7B-CHAT , LLAMA2-13B-CHAT , LLAMA-3.1-8B-INSTRUCT and others10 解释自回归一致性如何导致浅层安全对齐,并提出随机插入攻击
Published Jun 3 Abstract 作者用自回归一致性串起浅层对齐、插入攻击和最坏延续对齐。作者把浅层安全对齐和一类续写攻击都归到自回归一致性上。
提出 CodecAttack,在编解码器隐空间构造可穿透有损压缩的对抗音频
Published May 20
Evaluated models Qwen2-Audio-7B-Instruct , Audio Flamingo 3 , Qwen2.5-Omni 提出 GPO-V,用全局概率优化的视觉扰动越狱扩散视觉语言模型
Published May 8
Evaluated models LLaDA-V , LaViDA Abstract 作者用视觉扰动改 dVLM 的全局生成概率,以绕过两类拒绝。GPO-V 把越狱从“开头必须顺从”改成“整段去噪概率朝肯定方向走”。 。
提出 Misrouter,借 MoE 路由优化仅输入前缀并迁移攻击
Published May 6
Evaluated models GPT-4o mini , Qwen-Plus , Phi-4 and others18 提出 PEO,直接优化原提示词嵌入实现白盒越狱
Published Apr 28
Evaluated models Vicuna-7B-v1.3 , Llama-2-7B-Chat , Qwen3-4B-Instruct and others4 Abstract PEO 原位优化提示词嵌入、多轮只重攻失败样本。PEO 是一种不追加对抗 token 的 white-box 越狱:直接改已有提示词嵌入,并只对未成功样本更换续写目标再优化。
提出 TriageFuzz,用替代模型定位敏感片段做查询高效越狱
Published Mar 24
Evaluated models Gemma-7B-Instruct , Gemma2-9B-Instruct , LLaMA3-8B-Instruct and others9 提出多流扰动攻击,交织有害与良性任务绕过思考型 LLM 安全对齐
Published Mar 10
Evaluated models Qwen3 1.7B , Qwen3 4B , Qwen3 8B and others11 Abstract 多流扰动用任务交织测试 thinking 模式,作者称它同时冲击内容安全与推理稳定性。多流扰动攻击把有害任务与良性任务织进同一提示词,测试 thinking 模式的内容安全与推理稳定性。作者认为,交织多任务会拉长思考,使安全检测面对被打散的有害意图,并可能把推理用于合理化,或陷入崩溃与重复。方法不访问梯度。
Analyzing the attention head mechanism of continuation-triggered jailbreaks and proposing HCS
Published Mar 9
Evaluated models LLaMA-2-7B-Chat , Qwen2.5-7B-Instruct Abstract The authors state that jailbreaks arise from competition between two types of heads, and that HCS plus distillation can use this competition for inference-time intervention.The authors use attention head mechanism analysis for continuation-triggered jailbreaks: under the same harmful instruction, moving the continuation suffix from after the instruction to outside the prompt boundary makes the model more likely to continue generating along the suffix.
提出 TAO-Attack,用两阶段损失与 DPTO 优化越狱后缀
Published Mar 3
Evaluated models Llama-2-7B-Chat , Vicuna-7B-v1.5 , Mistral-7B-Instruct-0.2 and others12