Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 18 papers

Another 255papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.04589

    StegoMemory red team testing: agent persistent memory can be used as a cross-session covert channel

    提出 StegoMemory,评测智能体持久记忆作为跨会话隐写信道

    Published
    Setting
    AI Agent
    Evaluated models
    Llama 3.1 405B, Claude 3.5 Sonnet, GPT-4o and others13

    Abstract研究揭示智能体持久记忆可作为隐蔽信道跨会话传输机密,写入持久化是主要防御瓶颈,呼吁建立记忆完整性防御。

    Paper analysisRead analysis
  2. MMSkillRisk:多模态技能图像中的隐藏指令可诱导 Agent 执行未授权操作

    提出 MMSkillRisk 基准,评测多模态技能图像中的隐藏指令诱导 Agent 越权操作

    Published
    Evaluated models
    GPT-5.6-sol, Kimi-K2.6, Kimi-K3 and others6

    Abstract论文提出 MMSkillRisk 基准与 NCVA 攻击,揭示多模态技能中教学图像潜藏指令可引发未授权操作并与良性任务共存。

    Paper analysisRead analysis
  3. SinoGlyphBench:中文字形混淆下语言模型审核的诊断基准

    提出 SinoGlyphBench,用配对字形混淆诊断中文审核稳定性

    Published
    Evaluated models
    GPT-5.4 mini, GPT-5.5, DeepSeek V4 Flash and others12
    AbstractSinoGlyphBench 显示中文字形混淆会同时增加有害漏报和误报,全文扰动最重。

    SinoGlyphBench是一个配对诊断基准,用来看内容审核在可还原的中文字形混淆下是否还保持原决定。

    Paper analysisRead analysis
  4. SpeechJBB:语码转换语音下大型音频语言模型的越狱基准

    提出 SpeechJBB,评测语码转换语音下音频语言模型的越狱稳健性

    Published
    Evaluated models
    Qwen2.5-Omni-7B, Qwen3-Omni-30B-A3B-Instruct, Voxtral-Small-24B and others9
    AbstractSpeechJBB 用五语语码转换语音和伪词探针评测九个 LALM,作者将越狱归为对齐失败而非听不懂。

    SpeechJBB 用合成语音测量 LALM 在五语、语码转换和局部伪词混淆下的安全对齐,并另设口语理解对照。

    Paper analysisRead analysis
  5. AttacksarXiv 2606.01837

    论文提出 DSR 跨模态越狱框架:用良性输入诱导 MLLM 有害输出

    提出 DSR 跨模态越狱,用无害图文诱导 MLLM 生成有害图像

    Published
    Attacker
    Black-box
    Evaluated models
    gemini-2.5-flash-image, qwen-image-2.0, Tongyi Wanx 2.5
    AbstractDSR 用无害图文诱导商业 MLLM 输出有害图像,作者称组合能力会反过来扩大攻击面。

    DSR 是一种 black-box 跨模态越狱:输入侧不放显式有害内容,而让商业 MLLM 在推理中把无害图文重组成有害图像。

    Paper analysisRead analysis
  6. AttacksarXiv 2605.00583

    Jailbreaking vision-language models through the visual modality

    提出四类视觉越狱,把有害意图编码进图像以绕过安全拒答

    Published
    Evaluated models
    GPT-5.2, Claude-Haiku-4.5, Gemini-3-Flash and others8
    Abstract四类视觉越狱在六个 VLM 上检验文本对齐能否挡住视觉意图,模型与攻击之间差异大。

    四类视觉越狱用来检验前沿 VLM 的文本安全训练能否挡住由图像传达的有害意图。。

    Paper analysisRead analysis
  7. AttacksarXiv 2603.17239

    LAAF: A Systematic Red-Teaming Method and Automated Attack Framework for LPCI Vulnerabilities in Agentic LLM Systems

    Proposes LAAF, which automatically attacks LPCI vulnerabilities in agent systems in stages

    Published
    Setting
    AI Agent
    Evaluated models
    gemini-2.0-flash-001, claude-3-haiku-20240307, meta-llama/llama-3.1-70b-instruct and others5
    AbstractLAAF does LPCI red teaming with taxonomy plus stage seeding.

    The authors state that LAAF is an automated red-teaming framework built specifically for LPCI in agentic LLMs. The issue to address is that encoded, delayed, and conditionally triggered payloads can persist in memory or RAG and re-enter across sessions, whereas Garak and PyRIT do not use the previous round's breakthrough results to seed the next stage across the six stages.

    Paper analysisRead analysis
  8. AttacksarXiv 2603.07590

    模型作为乐高搭建者:用语义蓝图从无害积木拼装恶意

    提出 StructAttack,用结构图把无害语义槽诱导视觉模型拼成恶意内容

    Published
    Attacker
    Black-box
    Evaluated models
    GPT-4o (1120), Gemini-2.0-Flash (001), Gemini-2.5-Flash and others6
    AbstractStructAttack 把有害查询拆成无害槽并画进结构图,在黑盒单次查询下诱导 LVLM 填出有害内容。

    StructAttack 是针对 LVLM 的黑盒、单次查询越狱:把有害指令拆成单独看似无害的槽,画进结构图,再让模型把槽拼回有害内容。。

    Paper analysisRead analysis
  9. AttacksarXiv 2602.10148

    Red-Teaming Multimodal Reasoning: Cross-Modal Entanglement Attacks Jailbreak Vision-Language Models

    提出 COMET 跨模态纠缠攻击,越狱视觉语言模型

    Published
    Attacker
    Black-box
    Evaluated models
    GPT-4.1, GPT-4.1-mini, Gemini-2.5-Flash and others9
    AbstractCOMET 做黑盒跨模态纠缠越狱。

    COMET 是面向具备多模态推理的 VLM 的黑盒越狱,用来红队测试跨模态安全对齐。作者要处理的缺口是:把恶意线索分到图文的固定组合,测不到多步推理里才出现的漏洞。攻击不访问梯度,只构造图文输入。

    Paper analysisRead analysis
  10. AttacksarXiv 2601.15698

    Beyond Visual Safety: Jailbreaking Multimodal Large Language Models to Generate Harmful Images with Semantically Irrelevant Inputs

    提出 BVS 图文越狱,用中和拼接图和诱导提示词让模型生成有害图像

    Published
    Evaluated models
    GPT-5 (12 January 2026 release), Gemini 1.5 Flash (15 January 2026 release)
    AbstractBVS 以重建后再生成诱导有害图像。

    BVS 用图文对诱导 MLLM 生成有害图像。作者认为,相对文本越狱和单模态图像诱导,视觉生成的安全审查仍不充分。

    Paper analysisRead analysis
  11. AttacksarXiv 2507.10457

    论文提出 LPCI:针对 Agent 逻辑层与持久记忆的提示控制注入攻击

    提出 LPCI,把延迟条件载荷写入记忆与检索库以跨会话触发

    Published
    Setting
    AI Agent
    Evaluated models
    ChatGPT, Claude, LLaMA3 and others8
    Abstract作者定义 LPCI。

    作者把LPCI定义为针对智能体逻辑执行、记忆留存和工具集成的跨阶段漏洞类,而不是单次输入上的提示改写。

    Paper analysisRead analysis
  12. AttacksarXiv 2504.01094

    研究者提出 Multi-AudioJail

    提出 MULTI-AUDIOJAIL,以多语多口音和声学扰动越狱音频模型

    Published
    Attacker
    Black-box
    Evaluated models
    Qwen2-Audio, DiVA-llama-3-v0-8b, MERaLiON-AudioLLM-Whisper-SEA-LION and others5

    Abstract黑盒多语多口音音频加声学扰动可抬高 LALM 的 JSR,文本示范防御并非在每个模型上都下降。

    Paper analysisRead analysis
You have reached the end