Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 89 papers Another 265 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
构建 EpiReal-Bench,评测图像生成器将虚假主张渲染为可信证据
Published Oct 8
Evaluated models GPT-Image-2 , Nano Banana 2 , Grok Imagen 2.0 and others4 Abstract 四款商用图像模型能把假主张画成可信证据。EpiReal-Bench 用来量商用图像生成器会不会把虚假现实主张画成可信视觉证据。
提出 Red-TTT,在攻击过程中更新攻击者实现自动化越狱
Published Oct 4
Evaluated models Llama-3-8B-Instruct , gpt-oss-20b , gpt-4.1-mini and others4 提出 CodeMimicry,以结构化代码补全诱导模型生成有害内容
Published Sep 30
Evaluated models GPT-4o , GPT-4.1 , GPT-5-chat and others10 提出 SceneJail,利用视频情境上下文越狱视频多模态模型
Published Sep 30
Evaluated models Qwen2.5-VL-7B-Instruct , Qwen2.5-VL-32B-Instruct , Qwen3-VL-8B-Instruct and others8 提出 CollageAttack,用空间文本碎片重组越狱文生图模型
Published Sep 29
Evaluated models GPT-Image-2 , Doubao-Seedream-5.0-Lite , Wan2.7-Image-Pro and others5 Abstract 系统揭示 T2I 跨模态空间合成安全漏洞,证实离散无害元素可在图像层面重构有害意图并放大传播强度。
提出 BLINDBIAS,通过纯文本续写与前缀控制越狱黑盒模型
Published Sep 29
Evaluated models GLM-5 , Gemini-3.5-Flash , Qwen3-32B and others4 Abstract 作者认为,隐藏数值概率并不足以消除支持重复采样和前缀续写的解码攻击面。BLINDBIAS 是一种针对 sample-only 续写接口的 black-box 解码时越狱框架 ,研究没有目标数值概率时,采样能否支持逐步控制。
提出 FinRT,将消费金融自适应红队轨迹蒸馏为可复用对抗提示生成器
Published Sep 29
Evaluated models Llama-3.3-70B , Llama-3.1-8B , Mixtral-8x7B and others6 Abstract FinRT 用前向失效发现加校准代理 DPO,把消费金融红队收成单次前向生成器。FinRT 是面向消费金融的红队框架:先发现政策失效,再训练一个按政策、领域与目标行为出提示的生成器。
提出 RISE,迭代演化可复用策略对文生图模型做红队
Published Sep 28
Evaluated models DALL·E 3 , Nano Banana 2 , GPT-Image-2 and others7 提出推理通道预填与输出前缀组合攻击以越狱推理模型
Published Sep 24
Evaluated models Gemini 3 Flash Preview , DeepSeek V4 Flash , Claude Haiku 4.5 消融比较方言越狱中表层形式、文化框架与策略库的作用
Published Sep 15
Evaluated models GPT-4o , DeepSeek-Reasoner , DeepSeek-Chat 提出能力洗钱攻击,拆分任务向对齐模型套取能力
Published Sep 14
Evaluated models GPT-5.5 , Claude Opus 4.8 , Grok-4.3 and others7 Abstract 作者提出了能力洗钱攻击,发现未对齐编排器分解咨询对齐模型可恢复能力差距,指出需建立跨会话防御。
提出 CS-Guard 基准,评测代码生成护栏对虚构场景攻击的防御
Published Sep 9
Evaluated models CodeLlama-13B-Instruct , DeepSeekCoder-V2-Lite-16B , GPT-OSS-20B and others7 Abstract 论文提出了代码安全护栏基准 CS-Guard,评估发现现有护栏对虚构场景攻击和代码级恶意请求防御较弱。
提出任意字母置换密码越狱,无需微调即可诱导有害输出
Published Sep 9
Evaluated models Claude Sonnet 4 , Claude Sonnet 4.5 , Gemini 3 Flash (preview) and others7 Abstract 前沿大模型无需微调即可通过提示词学会字母置换密码,进而绕过分类器与对齐,作者呼吁关注能力提升带来的安全风险。
检验结构越狱 IICL 能否跨厂商泛化并与语言约束叠加
Published Sep 8
Evaluated models gemini-2.5-flash , gemini-2.5-flash-lite 提出 DIVA,将有害意图拆成视觉锚点与运动文本以越狱视频生成模型
Published Sep 7
Evaluated models Wan , CogVideoX , LTX-Video and others9 Abstract DIVA 用视觉锚点抑制语义漂移做视频越狱,并给出多条件安全基准 TI2VSafetyBench。DIVA 是针对带参考图的视频生成模型的免训练 black-box 越狱:用一致性机制本身堵住语义漂移这条安全逃逸路径。 。
提出 AdvPIE,在黑盒下搜索表面无害却生成有害图像的提示
Published Sep 5
Evaluated models Stable Diffusion 3.5 Large , FLUX.1-schnell , Safe-StableDiffusion 1.5 and others5 提出多轮越狱框架 BLUEPRINT,用世界观模拟与心理因素诱导有害输出
Published Sep 2
Evaluated models Qwen3-Next-80B , DeepSeek-V3.2 , GLM-4.7 and others6 Abstract BLUEPRINT 解耦多轮越狱策略与情境模拟,揭示任务具象化是摆脱拒绝的核心机制,为多轮安全防御提供新视角。BLUEPRINT 是一个将因子化社会影响力策略空间与跨轮世界观模拟解耦的多轮大语言模型安全评测框架。
提出 CRACK,用多智能体辩论在黑盒下越狱文生图多层安全过滤
Published Sep 1
Evaluated models Stable Diffusion v1.4 , SDXL , DALL·E 3 and others4 Abstract CRACK 以分层诊断的多智能体辩论搜索多层 T2I 过滤器的联合规避区域。CRACK 是面向文本生成图像模型多层安全栈的黑盒越狱框架,用几何上的 Detection Surface 解释为何粗粒度反馈不够。
提出 RedEvoAgent,演化攻击技能对黑盒智能体做自动红队
Published Aug 28
Evaluated models MiniMax-M2.5 , DeepSeek-V4-Flash , Qwen3.5-35B Abstract RedEvoAgent 用验证棘轮演化可读攻击技能,在两种产品级 harness 上多数设置高于固定工具与红队基线。RedEvoAgent 是面向产品级 black-box 智能体的自动红队方法,用一份可演化、人类可读的攻击技能编排多个越狱工具。 。
提出 MAMJ,在元层面交替优化多模态越狱的策略提示与攻击者权重
Published Aug 27
Evaluated models GPT-4o , Gemini-3-Pro-Preview , Seed 2.0