Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 22 papers

Another 240papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.04589

    StegoMemory red team testing: agent persistent memory can be used as a cross-session covert channel

    提出 StegoMemory,评测智能体持久记忆作为跨会话隐写信道

    Published
    Setting
    AI Agent
    Evaluated models
    Llama 3.1 405B, Claude 3.5 Sonnet, GPT-4o and others13

    Abstract研究揭示智能体持久记忆可作为隐蔽信道跨会话传输机密,写入持久化是主要防御瓶颈,呼吁建立记忆完整性防御。

    Paper analysisRead analysis
  2. MMSkillRisk:多模态技能图像中的隐藏指令可诱导 Agent 执行未授权操作

    提出 MMSkillRisk 基准,评测多模态技能图像中的隐藏指令诱导 Agent 越权操作

    Published
    Evaluated models
    GPT-5.6-sol, Kimi-K2.6, Kimi-K3 and others6

    Abstract论文提出 MMSkillRisk 基准与 NCVA 攻击,揭示多模态技能中教学图像潜藏指令可引发未授权操作并与良性任务共存。

    Paper analysisRead analysis
  3. AttacksarXiv 2609.18217

    研究:跨通道碎片化攻击可绕过 MCP 单通道防御

    提出跨通道分段攻击,利用 MCP 隐式信任外发敏感文件

    Published
    Evaluated models
    GPT-4o, GPT-4o-mini, GPT-5.4 and others15

    Abstract论文揭示了 MCP 多通道隐式信任层级,通过跨通道分段与协议级利用突破现有防御,展示了严重的凭证外发风险。

    Paper analysisRead analysis
  4. AttacksarXiv 2609.07216

    DIVA:利用视觉锚点对视频生成模型实施多模态越狱

    提出 DIVA,将有害意图拆成视觉锚点与运动文本以越狱视频生成模型

    Published
    Attacker
    Black-box
    Evaluated models
    Wan, CogVideoX, LTX-Video and others9
    AbstractDIVA 用视觉锚点抑制语义漂移做视频越狱,并给出多条件安全基准 TI2VSafetyBench。

    DIVA 是针对带参考图的视频生成模型的免训练 black-box 越狱:用一致性机制本身堵住语义漂移这条安全逃逸路径。。

    Paper analysisRead analysis
  5. SinoGlyphBench:中文字形混淆下语言模型审核的诊断基准

    提出 SinoGlyphBench,用配对字形混淆诊断中文审核稳定性

    Published
    Evaluated models
    GPT-5.4 mini, GPT-5.5, DeepSeek V4 Flash and others12
    AbstractSinoGlyphBench 显示中文字形混淆会同时增加有害漏报和误报,全文扰动最重。

    SinoGlyphBench是一个配对诊断基准,用来看内容审核在可还原的中文字形混淆下是否还保持原决定。

    Paper analysisRead analysis
  6. AttacksarXiv 2606.21732

    研究者提出 relinking 漏洞:LLM Agent 压缩边界可被拼出恶意指令

    提出 Relink 攻击,在 Agent 压缩边界将分散良性片段重组为恶意指令

    Published
    Setting
    AI Agent
    Evaluated models
    Gemma-4-31B-it, GPT-OSS-20B, Qwen3.6-27B and others15
    Abstract论文指出提示词压缩引入重链漏洞,提出 RELINK 攻击工具与 KBRA 边界审计防御,证明压缩边界应作为关键安全边界。

    本文研究了智能体基于摘要的提示词压缩所引入的新型安全漏洞——重链(Relinking),并提出了系统化的攻击构建方法与边界审计防御机制。

    Paper analysisRead analysis
  7. AttacksarXiv 2606.01837

    论文提出 DSR 跨模态越狱框架:用良性输入诱导 MLLM 有害输出

    提出 DSR 跨模态越狱,用无害图文诱导 MLLM 生成有害图像

    Published
    Attacker
    Black-box
    Evaluated models
    gemini-2.5-flash-image, qwen-image-2.0, Tongyi Wanx 2.5
    AbstractDSR 用无害图文诱导商业 MLLM 输出有害图像,作者称组合能力会反过来扩大攻击面。

    DSR 是一种 black-box 跨模态越狱:输入侧不放显式有害内容,而让商业 MLLM 在推理中把无害图文重组成有害图像。

    Paper analysisRead analysis
  8. AttacksarXiv 2605.00583

    Jailbreaking vision-language models through the visual modality

    提出四类视觉越狱,把有害意图编码进图像以绕过安全拒答

    Published
    Evaluated models
    GPT-5.2, Claude-Haiku-4.5, Gemini-3-Flash and others8
    Abstract四类视觉越狱在六个 VLM 上检验文本对齐能否挡住视觉意图,模型与攻击之间差异大。

    四类视觉越狱用来检验前沿 VLM 的文本安全训练能否挡住由图像传达的有害意图。。

    Paper analysisRead analysis
  9. AttacksarXiv 2603.17239

    LAAF: A Systematic Red-Teaming Method and Automated Attack Framework for LPCI Vulnerabilities in Agentic LLM Systems

    Proposes LAAF, which automatically attacks LPCI vulnerabilities in agent systems in stages

    Published
    Setting
    AI Agent
    Evaluated models
    gemini-2.0-flash-001, claude-3-haiku-20240307, meta-llama/llama-3.1-70b-instruct and others5
    AbstractLAAF does LPCI red teaming with taxonomy plus stage seeding.

    The authors state that LAAF is an automated red-teaming framework built specifically for LPCI in agentic LLMs. The issue to address is that encoded, delayed, and conditionally triggered payloads can persist in memory or RAG and re-enter across sessions, whereas Garak and PyRIT do not use the previous round's breakthrough results to seed the next stage across the six stages.

    Paper analysisRead analysis
  10. AttacksarXiv 2603.07590

    Model as Lego builder: assembling malicious content from harmless blocks using a semantic blueprint

    Propose StructAttack, which uses structural diagrams to induce visual models to assemble malicious content from harmless semantic slots.

    Published
    Attacker
    Black-box
    Evaluated models
    GPT-4o (1120), Gemini-2.0-Flash (001), Gemini-2.5-Flash and others6
    AbstractStructAttack decomposes a harmful query into harmless slots and draws them into a structure graph, inducing the LVLM to fill in harmful content under a black-box single query.

    StructAttack is a black-box, single-query jailbreak against LVLMs: it decomposes a harmful instruction into separate seemingly harmless slots, draws them into a structural diagram, and then makes the model reassemble the slots into harmful content.

    Paper analysisRead analysis
  11. AttacksarXiv 2602.10148

    Red-Teaming Multimodal Reasoning: Cross-Modal Entanglement Attacks Jailbreak Vision-Language Models

    提出 COMET 跨模态纠缠攻击,越狱视觉语言模型

    Published
    Attacker
    Black-box
    Evaluated models
    GPT-4.1, GPT-4.1-mini, Gemini-2.5-Flash and others9
    AbstractCOMET 做黑盒跨模态纠缠越狱。

    COMET 是面向具备多模态推理的 VLM 的黑盒越狱,用来红队测试跨模态安全对齐。作者要处理的缺口是:把恶意线索分到图文的固定组合,测不到多步推理里才出现的漏洞。攻击不访问梯度,只构造图文输入。

    Paper analysisRead analysis
  12. AttacksarXiv 2601.15698

    Beyond Visual Safety: Jailbreaking Multimodal Large Language Models to Generate Harmful Images with Semantically Irrelevant Inputs

    提出 BVS 图文越狱,用中和拼接图和诱导提示词让模型生成有害图像

    Published
    Evaluated models
    GPT-5 (12 January 2026 release), Gemini 1.5 Flash (15 January 2026 release)
    AbstractBVS 以重建后再生成诱导有害图像。

    BVS 用图文对诱导 MLLM 生成有害图像。作者认为,相对文本越狱和单模态图像诱导,视觉生成的安全审查仍不充分。

    Paper analysisRead analysis