Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 227papers have no tags yet and are not included in filtered results.

Attack type：Jailbreaks System type：Models and APIs System type：coding agent System component：Memory System component：Monitors System component：Image generation Clear all

Another 227papers do not have category tags yet and are not included in filtered results.

Evaluation and benchmarksarXiv 2610.11112Oct 8
EpiReal-Bench：商用图像生成模型虚假声明红队基准
构建 EpiReal-Bench，评测图像生成器将虚假主张渲染为可信证据
arXiv
2610.11112
Published
Oct 8
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
GPT-Image-2, Nano Banana 2, Grok Imagen 2.0 and others4
- AttacksJailbreaks
- ComponentImage generation
Abstract四款商用图像模型能把假主张画成可信证据。
EpiReal-Bench 用来量商用图像生成器会不会把虚假现实主张画成可信视觉证据。
Paper analysisRead analysis
DefensesarXiv 2610.09167Oct 7
Persist-3 用顺序检验识别未见越狱来源，提升 MTK 与 Prompt Guard 2 防御效果
提出 Persist-3 序贯检验，从隐藏表示识别未见越狱源
arXiv
2610.09167
Published
Oct 7
Layer
Model layer
Setting
Models and APIs
Evaluated models
Llama2-7B-chat, Qwen2.5-7B-Instruct, Gemma-2-9B-it and others4
- DefensesMonitoring and auditing
- AttacksJailbreaks
- ComponentMonitors
AbstractPersist-3 用有限窗口检验攻击流是否超出已知越狱源，检出率低于全历史 SR-DKW，但决策只依赖最近观测。
Persist-3 是一个有限记忆的序贯检测器，用来判断攻击表示流是否已经不能由任何一个已知越狱源解释。。
Paper analysisRead analysis
DefensesarXiv 2610.05401Oct 5
AVCE：面向扩散模型可验证概念擦除的审计感知遗忘框架
提出审计感知遗忘框架 AVCE，从文本与视觉通路擦除扩散模型概念
arXiv
2610.05401
Published
Oct 5
Layer
Training and data layer
Setting
Models and APIs
Attacker
White-box, Black-box
Evaluated models
Stable Diffusion XL (SDXL), Stable Diffusion v1.5 (SD v1.5), Flux 1.0
- DefensesModel hardening
- AttacksJailbreaks
- ComponentImage generation
AbstractAVCE 在审计锚点上改两条注意力通路。
AVCE 是面向扩散模型的概念擦除方法，要让擦除经得起绕过文本条件的潜空间审计，而不只是挡住对抗提示词。
Paper analysisRead analysis
DefensesarXiv 2610.02413Oct 2
研究：分类后缀可提升激活探针的分布外恶意输入检测
用分类后缀提升激活探针对分布外恶意输入的检测
arXiv
2610.02413
Published
Oct 2
Layer
Model layer
Setting
Models and APIs
Evaluated models
Llama-3.1-8B, Qwen3.5-9B, Gemma-4-12B
- DefensesMonitoring and auditing
- AttacksJailbreaks
- ComponentMonitors
Abstract作者称排序增益来自分类格式，低 FPR 精度来自点名准则。
用户轮后的分类后缀，被作者用作激活探针的分布外检测干预：排序看格式，低 FPR 精度看是否点名恶意/良性。
Paper analysisRead analysis
AttacksarXiv 2609.38253Sep 29
CollageAttack: Exploiting cross-modal alignment defects for spatial text composition jailbreaks against T2I models.
提出 CollageAttack，用空间文本碎片重组越狱文生图模型
arXiv
2609.38253
Published
Sep 29
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
GPT-Image-2, Doubao-Seedream-5.0-Lite, Wan2.7-Image-Pro and others5
- AttacksJailbreaks
- TechniqueEncoding and obfuscation
- ComponentImage generation
Abstract系统揭示 T2I 跨模态空间合成安全漏洞，证实离散无害元素可在图像层面重构有害意图并放大传播强度。
Paper analysisRead analysis
AttacksarXiv 2609.34920Sep 28
RISE：用迭代策略演化对现代文生图模型做红队测试
提出 RISE，迭代演化可复用策略对文生图模型做红队
arXiv
2609.34920
Published
Sep 28
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
DALL·E 3, Nano Banana 2, GPT-Image-2 and others7
- AttacksJailbreaks
- TechniqueAutomated search
- ComponentImage generation
Paper analysisRead analysis
AttacksarXiv 2609.31032Sep 25
TempQ-Jail：面向文生视频越狱的查询受限候选排序方法
提出 TempQ-Jail，以查询受限候选排序越狱文生视频模型
arXiv
2609.31032
Published
Sep 25
Layer
Prompt layer
Setting
Models and APIs
- AttacksJailbreaks
- ComponentImage generation
Abstract待补读全文。
待补读全文。
Paper analysisRead analysis
DefensesarXiv 2609.30841Sep 25
为何扩散语言模型的越狱会成功：能量景观分析
用能量势垒信号检测扩散语言模型的越狱
arXiv
2609.30841
Published
Sep 25
Layer
Model layer
Setting
Models and APIs
Evaluated models
LLaDA-8B-Instruct, LLaDA-1.5, Dream-v0-Instruct-7B and others4
- DefensesMonitoring and auditing
- AttacksJailbreaks
- ComponentMonitors
Abstract能量势垒把 dLLM 越狱分成掩盖初始状态或中途越垒，三个 logit 信号据此互补检测。
Bach 等提出用去噪能量景观解释 masked diffusion 语言模型上的越狱，并由此得到三个免训练检测信号。。
Paper analysisRead analysis
DefensesarXiv 2609.20129Sep 17
局部稀疏性实现无监督 LLM 安全检测
提出局部稀疏无监督安全检测，标记偏离安全分布的输入
arXiv
2609.20129
Published
Sep 17
Layer
Model layer
Setting
Models and APIs
Evaluated models
qwen2-1.5b-instruct, ministral-8b-instruct, llama3-8b-instruct and others6
- DefensesMonitoring and auditing
- AttacksJailbreaks
- ComponentMonitors
Paper analysisRead analysis
DefensesarXiv 2609.13534Sep 12
HPD 与 HERALD：用跨层有害性传播轨迹检测越狱提示
提出 HERALD，用跨层有害投影轨迹检测越狱提示
arXiv
2609.13534
Published
Sep 12
Layer
Model layer
Setting
Models and APIs
Evaluated models
Llama-3.1-8B-Instruct, Mistral-7B-Instruct, OLMo2-7B-Instruct and others4
- DefensesMonitoring and auditing
- AttacksJailbreaks
- ComponentMonitors
AbstractHPD 用跨层投影形状区分有害与良性提示。
Paper analysisRead analysis
AttacksarXiv 2609.07216Sep 7
DIVA：利用视觉锚点对视频生成模型实施多模态越狱
提出 DIVA，将有害意图拆成视觉锚点与运动文本以越狱视频生成模型
arXiv
2609.07216
Published
Sep 7
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Wan, CogVideoX, LTX-Video and others9
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentImage generation
AbstractDIVA 用视觉锚点抑制语义漂移做视频越狱，并给出多条件安全基准 TI2VSafetyBench。
DIVA 是针对带参考图的视频生成模型的免训练 black-box 越狱：用一致性机制本身堵住语义漂移这条安全逃逸路径。。
Paper analysisRead analysis
AttacksarXiv 2609.06094Sep 5
AdvPIE：面向文生图模型隐式漏洞的自动红队框架
提出 AdvPIE，在黑盒下搜索表面无害却生成有害图像的提示
arXiv
2609.06094
Published
Sep 5
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Stable Diffusion 3.5 Large, FLUX.1-schnell, Safe-StableDiffusion 1.5 and others5
- AttacksJailbreaks
- TechniqueAutomated search
- ComponentImage generation
Paper analysisRead analysis
InterpretabilityarXiv 2609.04721Sep 4
研究：拒答方向可跨架构迁移，安全工具可按写入位置重新估计
在写入点定位拒答方向，经刚性旋转跨架构迁移并门控放大
arXiv
2609.04721
Published
Sep 4
Layer
Model layer
Setting
Models and APIs
Evaluated models
Falcon-Mamba-7B, Falcon3-Mamba-7B, Llama-3.1-8B and others8
- DefensesInference-time intervention
- AttacksJailbreaks
- RiskInappropriate refusal
- ComponentMonitors
Abstract拒答方向可经刚性旋转跨架构迁移，但必须在各架构的写入点读取。
作者研究拒答表示是否随架构改变，结论是表示共享、读取位置随架构变。
Paper analysisRead analysis
AttacksarXiv 2609.01168Sep 1
CRACK：用多智能体辩论越狱多层安全过滤的 T2I 模型
提出 CRACK，用多智能体辩论在黑盒下越狱文生图多层安全过滤
arXiv
2609.01168
Published
Sep 1
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Stable Diffusion v1.4, SDXL, DALL·E 3 and others4
- AttacksJailbreaks
- TechniqueAutomated search
- ComponentImage generation
AbstractCRACK 以分层诊断的多智能体辩论搜索多层 T2I 过滤器的联合规避区域。
CRACK 是面向文本生成图像模型多层安全栈的黑盒越狱框架，用几何上的 Detection Surface 解释为何粗粒度反馈不够。
Paper analysisRead analysis
AttacksarXiv 2606.01837Jun 1
论文提出 DSR 跨模态越狱框架：用良性输入诱导 MLLM 有害输出
提出 DSR 跨模态越狱，用无害图文诱导 MLLM 生成有害图像
arXiv
2606.01837
Published
Jun 1
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
gemini-2.5-flash-image, qwen-image-2.0, Tongyi Wanx 2.5
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentImage generation
AbstractDSR 用无害图文诱导商业 MLLM 输出有害图像，作者称组合能力会反过来扩大攻击面。
DSR 是一种 black-box 跨模态越狱：输入侧不放显式有害内容，而让商业 MLLM 在推理中把无害图文重组成有害图像。
Paper analysisRead analysis
DefensesarXiv 2605.25893May 25
D²-Monitor：基于犹豫信号的扩散大语言模型动态安全监控
提出 D²-Monitor，按犹豫步数把难提示路由到更强探针
arXiv
2605.25893
Published
May 25
Layer
Model layer
Setting
Models and APIs
Evaluated models
LLaDA-8B-Base, LLaDA-8B-Instruct, LLaDA-1.5-8B and others4
- DefensesMonitoring and auditing
- AttacksJailbreaks
- ComponentMonitors
Paper analysisRead analysis
AttacksarXiv 2603.07028Mar 7
Two frames suffice: a temporal attack for jailbreaking text-to-video models
Propose TFM, using start and end frames and implicit substitution to jailbreak text-to-video models
arXiv
2603.07028
Published
Mar 7
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Pixverse V5, Hailuo 02, Kling 2.1 Master and others4
- AttacksJailbreaks
- TechniqueEncoding and obfuscation
- ComponentImage generation
AbstractTFM first extracts start and end frames and then performs implicit substitution.
TFM is a strictly black-box prompt jailbreak for text-to-video that exploits the model's temporal infilling of unspecified intermediate processes.
Paper analysisRead analysis
AttacksarXiv 2602.10179Feb 11
研究者提出视觉中心越狱攻击 VJA
提出纯视觉越狱攻击 VJA，把有害编辑指令编码进图像
arXiv
2602.10179
Published
Feb 11
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Nano Banana Pro, GPT Image 1.5, Qwen-Image-Edit and others9
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentImage generation
Paper analysisRead analysis
AttacksarXiv 2601.15698Jan 22
Beyond Visual Safety: Jailbreaking Multimodal Large Language Models to Generate Harmful Images with Semantically Irrelevant Inputs
提出 BVS 图文越狱，用中和拼接图和诱导提示词让模型生成有害图像
arXiv
2601.15698
Published
Jan 22
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
GPT-5 (12 January 2026 release), Gemini 1.5 Flash (15 January 2026 release)
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentVision
AbstractBVS 以重建后再生成诱导有害图像。
BVS 用图文对诱导 MLLM 生成有害图像。作者认为，相对文本越狱和单模态图像诱导，视觉生成的安全审查仍不充分。
Paper analysisRead analysis
AttacksarXiv 2601.07141Jan 12
MacPrompt: Hybrid-Language Guided Jailbreak Attack Against Text-to-Image Models
提出 MacPrompt 跨语言字符重组越狱，绕过文生图模型的过滤与概念移除
arXiv
2601.07141
Published
Jan 12
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
SD v2.1, ESD, SLD (Max) and others14
- AttacksJailbreaks
- TechniqueEncoding and obfuscation
- ComponentImage generation
Paper analysisRead analysis

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop