Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 265papers have no tags yet and are not included in filtered results.

Impact：Harmful content Attacker access：Black-box System component：Guardrails and judges Clear all

Another 265papers do not have category tags yet and are not included in filtered results.

AttacksarXiv 2610.10742Oct 8
BRANCH 方法绕过 6 套多扫描器护栏系统
提出 BRANCH 方法，用分支搜索绕过多扫描器护栏
arXiv
2610.10742
Published
Oct 8
Layer
Application layer
Setting
LLM applications
Attacker
Black-box
Evaluated models
Meta Llama Guard 3 8B, Meta Llama Guard 7B, Meta Llama Guard 3 1B and others18
- AttacksDetection evasion
- TechniqueAutomated search
- ComponentGuardrails and judges
Paper analysisRead analysis
DefensesarXiv 2610.03434Oct 2
Persona Guardrail：面向智能体系统的生产级防御框架
提出 Persona Guardrail，强制客服智能体守住功能边界
arXiv
2610.03434
Published
Oct 2
Layer
Application layer
Setting
AI Agent
Attacker
Black-box
Evaluated models
Qwen3-30B-A3B, Qwen3-VL-30B, Qwen3-8B and others5
- DefensesDetection and filtering
- AttacksJailbreaks
- ComponentGuardrails and judges
AbstractPersona Guardrail 用功能边界做同步输入输出校验，并在 PAGE 与生产延迟预算下给出评测。
Persona Guardrail 是客服向智能体的同步运行时防御：先写明功能边界，再决定放行或拦截，而不是只检测某一攻击类。
Paper analysisRead analysis
DefensesarXiv 2610.02853Oct 2
研究提出基于收缩约束状态空间模型的有界可达性与越狱检测方法
提出收缩约束 SSM 安全头，认证嵌入扰动并检测越狱
arXiv
2610.02853
Published
Oct 2
Layer
Prompt layer
Setting
Models and APIs
Attacker
White-box, Black-box
Evaluated models
ToySSMClassifier, S4 safety head
- DefensesDetection and filtering
- AttacksJailbreaks
- ComponentGuardrails and judges
Abstract收缩给出玩具 LTI 的有界认证。
给 SSM 安全头一个收缩条件，并在越狱检测上使用收缩正则的 S4 头。。
Paper analysisRead analysis
AttacksarXiv 2609.38253Sep 29
CollageAttack: Exploiting cross-modal alignment defects for spatial text composition jailbreaks against T2I models.
提出 CollageAttack，用空间文本碎片重组越狱文生图模型
arXiv
2609.38253
Published
Sep 29
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
GPT-Image-2, Doubao-Seedream-5.0-Lite, Wan2.7-Image-Pro and others5
- AttacksJailbreaks
- TechniqueEncoding and obfuscation
- ComponentImage generation
Abstract系统揭示 T2I 跨模态空间合成安全漏洞，证实离散无害元素可在图像层面重构有害意图并放大传播强度。
Paper analysisRead analysis
AttacksarXiv 2609.34920Sep 28
RISE：用迭代策略演化对现代文生图模型做红队测试
提出 RISE，迭代演化可复用策略对文生图模型做红队
arXiv
2609.34920
Published
Sep 28
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
DALL·E 3, Nano Banana 2, GPT-Image-2 and others7
- AttacksJailbreaks
- TechniqueAutomated search
- ComponentImage generation
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2609.09798Sep 9
CS-Guard：首个面向代码生成安全的 LLM 护栏评测基准
提出 CS-Guard 基准，评测代码生成护栏对虚构场景攻击的防御
arXiv
2609.09798
Published
Sep 9
Layer
Prompt layer
Setting
coding agent
Attacker
Black-box
Evaluated models
CodeLlama-13B-Instruct, DeepSeekCoder-V2-Lite-16B, GPT-OSS-20B and others7
- AttacksJailbreaks
- ComponentGuardrails and judges
Abstract论文提出了代码安全护栏基准 CS-Guard，评估发现现有护栏对虚构场景攻击和代码级恶意请求防御较弱。
Paper analysisRead analysis
AttacksarXiv 2609.09553Sep 9
研究：任意密文攻击前沿大模型无需微调即可越狱
提出任意字母置换密码越狱，无需微调即可诱导有害输出
arXiv
2609.09553
Published
Sep 9
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Claude Sonnet 4, Claude Sonnet 4.5, Gemini 3 Flash (preview) and others7
- AttacksJailbreaks
- TechniqueEncoding and obfuscation
- ComponentGuardrails and judges
Abstract前沿大模型无需微调即可通过提示词学会字母置换密码，进而绕过分类器与对齐，作者呼吁关注能力提升带来的安全风险。
Paper analysisRead analysis
AttacksarXiv 2609.07216Sep 7
DIVA：利用视觉锚点对视频生成模型实施多模态越狱
提出 DIVA，将有害意图拆成视觉锚点与运动文本以越狱视频生成模型
arXiv
2609.07216
Published
Sep 7
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Wan, CogVideoX, LTX-Video and others9
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentImage generation
AbstractDIVA 用视觉锚点抑制语义漂移做视频越狱，并给出多条件安全基准 TI2VSafetyBench。
DIVA 是针对带参考图的视频生成模型的免训练 black-box 越狱：用一致性机制本身堵住语义漂移这条安全逃逸路径。。
Paper analysisRead analysis
DefensesarXiv 2609.06540Sep 6
SRD-GUARD：通过语义改写与多模型联合评分暴露潜在意图的 LLM 防御框架
提出 SRD-GUARD，以语义改写与多模型联合评分拦截包装式越狱
arXiv
2609.06540
Published
Sep 6
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Llama-3-8B-Uncensored, DeepSeek-V4-Flash
- DefensesDetection and filtering
- AttacksJailbreaks
- ComponentGuardrails and judges
Paper analysisRead analysis
AttacksarXiv 2609.01168Sep 1
CRACK：用多智能体辩论越狱多层安全过滤的 T2I 模型
提出 CRACK，用多智能体辩论在黑盒下越狱文生图多层安全过滤
arXiv
2609.01168
Published
Sep 1
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Stable Diffusion v1.4, SDXL, DALL·E 3 and others4
- AttacksJailbreaks
- TechniqueAutomated search
- ComponentImage generation
AbstractCRACK 以分层诊断的多智能体辩论搜索多层 T2I 过滤器的联合规避区域。
CRACK 是面向文本生成图像模型多层安全栈的黑盒越狱框架，用几何上的 Detection Surface 解释为何粗粒度反馈不够。
Paper analysisRead analysis
AttacksarXiv 2607.27373Jul 30
RoguePrompt 用双层编码绕过 LLM 审核
提出 RoguePrompt 双层编码自重构越狱，绕过 LLM 审核
arXiv
2607.27373
Published
Jul 30
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
OpenAI GPT-4o (gpt-4o-2024-11-20), Anthropic Claude 3 Opus (claude-3-opus-20240229), Google Gemini 1.5 Pro (gemini-1.5-pro-002)
- AttacksJailbreaks
- TechniqueEncoding and obfuscation
- ComponentGuardrails and judges
Paper analysisRead analysis
AttacksarXiv 2606.21077Jun 19
OTTER：仅替换五个 token 即可绕过 GPT 系列毒性审核
提出 OTTER 词元替换越狱，绕过表面毒性审核诱导有害回答
arXiv
2606.21077
Published
Jun 19
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
gpt-4-turbo, gpt-4o, gpt-4o-mini and others4
- AttacksJailbreaks
- TechniqueEncoding and obfuscation
- ComponentGuardrails and judges
Abstract论文展示了表面毒性与恶意意图的解耦现象，通过标准 API 实现黑盒越狱测试，并提出闭环分类器加固建议。
Paper analysisRead analysis
AttacksarXiv 2606.16751Jun 15
UNIATTACK：面向多层防御的自动化越狱攻击框架
提出 UniAttack 单轮黑盒越狱框架，融合攻击特征绕过多层防御
arXiv
2606.16751
Published
Jun 15
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
DeepSeek-Chat, DeepSeek-Reasoner, GPT-4.1-Nano and others9
- AttacksJailbreaks
- TechniqueAutomated search
- ComponentGuardrails and judges
Paper analysisRead analysis
AttacksarXiv 2606.01837Jun 1
论文提出 DSR 跨模态越狱框架：用良性输入诱导 MLLM 有害输出
提出 DSR 跨模态越狱，用无害图文诱导 MLLM 生成有害图像
arXiv
2606.01837
Published
Jun 1
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
gemini-2.5-flash-image, qwen-image-2.0, Tongyi Wanx 2.5
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentImage generation
AbstractDSR 用无害图文诱导商业 MLLM 输出有害图像，作者称组合能力会反过来扩大攻击面。
DSR 是一种 black-box 跨模态越狱：输入侧不放显式有害内容，而让商业 MLLM 在推理中把无害图文重组成有害图像。
Paper analysisRead analysis
AttacksarXiv 2605.18915May 18
DMN：面向多图输入的多模态大模型组合式越狱框架
提出多图越狱框架 DMN，把有害意图拆进图像序列绕过安全护栏
arXiv
2605.18915
Published
May 18
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
GPT-4V, GPT-4o, GPT-5 and others10
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentVision
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2604.01444Apr 2
烹饪风险：大语言模型食品安全风险的基准测试与降低
提出 FoodGuardBench 与护栏 FoodGuard-4B，评测并降低食品危害越狱
arXiv
2604.01444
Published
Apr 2
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Claude-3.7-Sonnet, GPT-4o, GPT-4.1 and others10
- DefensesDetection and filtering
- AttacksJailbreaks
- TechniqueAutomated search
- ComponentGuardrails and judges
Paper analysisRead analysis
AttacksarXiv 2603.07028Mar 7
两帧即可：针对文本到视频模型越狱的时序攻击
提出 TFM，用起止帧与隐式替换越狱文生视频模型
arXiv
2603.07028
Published
Mar 7
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Pixverse V5, Hailuo 02, Kling 2.1 Master and others4
- AttacksJailbreaks
- TechniqueEncoding and obfuscation
- ComponentImage generation
AbstractTFM 先抽起止帧再做隐式替换。
TFM 是面向文生视频的严格黑盒提示越狱，利用模型对未写明中间过程的时间补全。
Paper analysisRead analysis
AttacksarXiv 2602.10179Feb 11
研究者提出视觉中心越狱攻击 VJA
提出纯视觉越狱攻击 VJA，把有害编辑指令编码进图像
arXiv
2602.10179
Published
Feb 11
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Nano Banana Pro, GPT Image 1.5, Qwen-Image-Edit and others9
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentImage generation
Paper analysisRead analysis
AttacksarXiv 2601.22398Jan 30
Jailbreaking vision-language models via multimodal reasoning
提出 ReAct 双策略，按反馈改写提示并扰动图像绕过 VLM 安全过滤
arXiv
2601.22398
Published
Jan 30
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Gemini-2.0-Flash
- AttacksJailbreaks
- TechniqueAutomated search
- ComponentVision
Paper analysisRead analysis
AttacksarXiv 2601.07141Jan 12
MacPrompt：面向文本到图像模型的混合语言引导越狱攻击
提出 MacPrompt 跨语言字符重组越狱，绕过文生图模型的过滤与概念移除
arXiv
2601.07141
Published
Jan 12
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
SD v2.1, ESD, SLD (Max) and others14
- AttacksJailbreaks
- TechniqueEncoding and obfuscation
- ComponentImage generation
Paper analysisRead analysis

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop