Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 43 papers Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 OPUR 攻击,用似然梯度优化对抗后缀越狱 LLM 智能体
Published Oct 7
Evaluated models Llama-3.1-8B-Instruct , Ministral-8B-Instruct-2410 评估应用决策层的输入注入与隐私推断风险
Published Oct 4
Evaluated models Jev , NanoJev Abstract Jev 的类型化决策可被输入与训练操纵,也会泄露信息,并同时支持检测与滥用。Jev 是 TypeSafe 的 System One 模型,把应用 state 和固定问题变成 Choice、Noul 或 Score 的类型化决策与概率。作者用官方 API 和可改训练的 NanoJev,考察它作为决策层时的操纵、泄露与双重用途。
提出 PrivDrift 基准,审计话题漂移后的用户秘密复述
Published Sep 25
Evaluated models GPT-OSS-120B , DeepSeek-R1 , Qwen3-VL-235B 消融比较方言越狱中表层形式、文化框架与策略库的作用
Published Sep 15
Evaluated models GPT-4o , DeepSeek-Reasoner , DeepSeek-Chat 提出 SAST-IR,用有状态攻击者迭代说服无记忆模型接受反事实
Published Sep 15
Evaluated models DeepSeek-Chat 提出 MIPC 与 CFA,观察模型自拟测验后接受开发者身份
Published Sep 3
Evaluated models ChatGPT , Claude , Qwen3.7-Plus and others5 Abstract 自拟测验可造成对话层虚假认证,但所测授权边界并未因此改变。这项工作把“模型自己出题、自己批改、再宣布身份已核验”定义成对话层认证失败,并与后端提权分开。
提出多轮越狱框架 BLUEPRINT,用世界观模拟与心理因素诱导有害输出
Published Sep 2
Evaluated models Qwen3-Next-80B , DeepSeek-V3.2 , GLM-4.7 and others6 Abstract BLUEPRINT 解耦多轮越狱策略与情境模拟,揭示任务具象化是摆脱拒绝的核心机制,为多轮安全防御提供新视角。BLUEPRINT 是一个将因子化社会影响力策略空间与跨轮世界观模拟解耦的多轮大语言模型安全评测框架。
提出广度优先后缀搜索 BOSS,改进 GCG 越狱优化
Published Sep 2
Evaluated models Llama-2-7B-Chat , Yi-1.5-9B-Chat , Qwen2-7B-Instruct and others8 Abstract BOSS 把 GCG 类优化从单条深搜索改为多条短轨迹加源侧诊断。BOSS 是插在 GCG 类离散 suffix 优化上的搜索框架:局部梯度更新不变,变的是固定预算花在深度还是广度。
提出 DIVA,利用跨步条件传播对离散扩散视觉语言模型实施视觉越狱
Published Sep 2
Evaluated models LLaDA-V , MMaDA , LLaDA2.0-Uni 提出 SN-Guided Diffusion,利用安全神经元实现离线越狱
Published Aug 8
Evaluated models Qwen2.5-7B-Instruct , LLaDA-8B-Instruct , Dream-Instruct-7B and others15 Abstract 论文揭示了扩散语言模型对自回归安全神经元的继承性,并提出纯离线黑盒越狱框架 SN-Guided Diffusion。论文系统评估了扩散大语言模型(DLLM)在安全对齐中的双重角色——既作为白盒攻击目标,又作为黑盒越狱生成的对抗工具。
提出 Concept2Scenario,借助内部概念归因发现可迁移的越狱场景
Published Jul 26
Evaluated models Qwen3.5-9B , Llama-3.1-8B , Ministral-3-8B and others6 Abstract 该研究从表征空间因果归因揭示场景削弱拒绝的机制,发现可复用脆弱场景先验,提升多模型黑盒越狱效能与探索速度。
评测多语言与编码混淆提示下模型生成钓鱼与键盘记录内容的遵从
Published Jun 29
Evaluated models DeepSeek-V3.2 , Gemini 2.5 Flash , GPT-5 Mini and others6 提出 SlotGCG,按注意力选槽插入对抗 token 以越狱指令模型
Published Jun 4
Evaluated models LLAMA2-7B-CHAT , LLAMA2-13B-CHAT , LLAMA-3.1-8B-INSTRUCT and others10 构建 MultiTurnPSB,评测四轮医疗越狱与分类器输入防御
Published May 30
Evaluated models GPT-4.1-mini , Claude Sonnet 4.5 Abstract 多轮攻击加剧医疗模型风险,分类器干预有效但受高误报率制约。MultiTurnPSB 针对患者端医疗大模型在持续交互中的安全风险,构建了包含三种攻击模态的四轮对抗评测基准。
提出 Persona Attack,分步写入对话记忆指令以越狱
Published May 29
Evaluated models GPT-4o , Llama-3.2-3B-Instruct , ChatGPT-4o and others5 提出 CodecAttack,在编解码器隐空间构造可穿透有损压缩的对抗音频
Published May 20
Evaluated models Qwen2-Audio-7B-Instruct , Audio Flamingo 3 , Qwen2.5-Omni 提出 GPO-V,用全局概率优化的视觉扰动越狱扩散视觉语言模型
Published May 8
Evaluated models LLaDA-V , LaViDA Abstract 作者用视觉扰动改 dVLM 的全局生成概率,以绕过两类拒绝。GPO-V 把越狱从“开头必须顺从”改成“整段去噪概率朝肯定方向走”。 。
提出 Misrouter,借 MoE 路由优化仅输入前缀并迁移攻击
Published May 6
Evaluated models GPT-4o mini , Qwen-Plus , Phi-4 and others18 提出 PEO,直接优化原提示词嵌入实现白盒越狱
Published Apr 28
Evaluated models Vicuna-7B-v1.3 , Llama-2-7B-Chat , Qwen3-4B-Instruct and others4 Abstract PEO 原位优化提示词嵌入、多轮只重攻失败样本。PEO 是一种不追加对抗 token 的 white-box 越狱:直接改已有提示词嵌入,并只对未成功样本更换续写目标再优化。
Propose PCSA, which uses persona-based multi-turn simulation of counseling clients to induce harmful empathetic responses.
Published Apr 7
Evaluated models Llama-3.1-8B , Llama-3.1-70B , GPT-3.5-Turbo and others8