Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 12 papers

Another 240papers do not have category tags yet and are not included in filtered results.

  1. AttacksarXiv 2610.04589

    StegoMemory red team testing: agent persistent memory can be used as a cross-session covert channel

    提出 StegoMemory,评测智能体持久记忆作为跨会话隐写信道

    Published
    Setting
    AI Agent
    Evaluated models
    Llama 3.1 405B, Claude 3.5 Sonnet, GPT-4o and others13

    Abstract研究揭示智能体持久记忆可作为隐蔽信道跨会话传输机密,写入持久化是主要防御瓶颈,呼吁建立记忆完整性防御。

    Paper analysisRead analysis
  2. MMPIBench:多模态提示注入对六种 Agent 框架的跨框架评测

    用 MMPIBench 评测多模态提示注入对 Agent 框架的影响

    Published
    Setting
    AI Agent
    Evaluated models
    Claude Opus 4.8, GPT-5.4, Gemini 3.1 Pro and others6

    Abstract论文提出 MMPIBench 评测多模态提示注入对智能体的影响,发现模型主导行为、尝试远超完成,音频通道缺乏防护。

    Paper analysisRead analysis
  3. AttacksarXiv 2606.12716

    PaperGuard:针对多模态 AI 同行评审的攻击与防御基准

    提出 PaperGuard,用图文注入与梯度扰动抬高自动审稿分数并检测恶意指令

    Published
    Evaluated models
    Claude-sonnet-4.5, GPT-4o, GPT-4.1 and others11
    AbstractPaperGuard 测到提示注入与白盒视觉抬分,并比较分块检索防御。

    PaperGuard同时评测并检测多模态 AI 审稿中的评分操纵。

    Paper analysisRead analysis
  4. SpeechJBB:语码转换语音下大型音频语言模型的越狱基准

    提出 SpeechJBB,评测语码转换语音下音频语言模型的越狱稳健性

    Published
    Evaluated models
    Qwen2.5-Omni-7B, Qwen3-Omni-30B-A3B-Instruct, Voxtral-Small-24B and others9
    AbstractSpeechJBB 用五语语码转换语音和伪词探针评测九个 LALM,作者将越狱归为对齐失败而非听不懂。

    SpeechJBB 用合成语音测量 LALM 在五语、语码转换和局部伪词混淆下的安全对齐,并另设口语理解对照。

    Paper analysisRead analysis
  5. AttacksarXiv 2604.14604

    The AudioHijack framework achieves covert audio prompt injection against 13 speech large models

    提出 AudioHijack,用不可感知对抗音频对语音模型做上下文无关提示注入

    Published
    Evaluated models
    SpeechGPT, GLM-4-Voice, VITA-Audio and others15

    Abstract提出了 AudioHijack 框架,揭示了 LALM 对听觉提示注入的脆弱性与传统防御的局限。

    Paper analysisRead analysis
  6. AttacksarXiv 2603.17239

    LAAF: A Systematic Red-Teaming Method and Automated Attack Framework for LPCI Vulnerabilities in Agentic LLM Systems

    Proposes LAAF, which automatically attacks LPCI vulnerabilities in agent systems in stages

    Published
    Setting
    AI Agent
    Evaluated models
    gemini-2.0-flash-001, claude-3-haiku-20240307, meta-llama/llama-3.1-70b-instruct and others5
    AbstractLAAF does LPCI red teaming with taxonomy plus stage seeding.

    The authors state that LAAF is an automated red-teaming framework built specifically for LPCI in agentic LLMs. The issue to address is that encoded, delayed, and conditionally triggered payloads can persist in memory or RAG and re-enter across sessions, whereas Garak and PyRIT do not use the previous round's breakthrough results to seed the next stage across the six stages.

    Paper analysisRead analysis
  7. AttacksarXiv 2511.10692

    StyleBreak:利用风格化音频越狱揭示大型音频语言模型的对齐漏洞

    提出 StyleBreak 风格化音频越狱,利用语音属性绕过音频语言模型对齐

    Published
    Attacker
    Black-box
    Evaluated models
    Qwen2-Audio-7B-Instruct, MERaLiON-AudioLLM-Whisper-SEA-LION, Ultravox-v0.4.1-Llama-3.1-8B and others6
    Paper analysisRead analysis
  8. AttacksarXiv 2507.10457

    论文提出 LPCI:针对 Agent 逻辑层与持久记忆的提示控制注入攻击

    提出 LPCI,把延迟条件载荷写入记忆与检索库以跨会话触发

    Published
    Setting
    AI Agent
    Evaluated models
    ChatGPT, Claude, LLaMA3 and others8
    Abstract作者定义 LPCI。

    作者把LPCI定义为针对智能体逻辑执行、记忆留存和工具集成的跨阶段漏洞类,而不是单次输入上的提示改写。

    Paper analysisRead analysis
  9. AttacksarXiv 2504.01094

    研究者提出 Multi-AudioJail

    提出 MULTI-AUDIOJAIL,以多语多口音和声学扰动越狱音频模型

    Published
    Attacker
    Black-box
    Evaluated models
    Qwen2-Audio, DiVA-llama-3-v0-8b, MERaLiON-AudioLLM-Whisper-SEA-LION and others5

    Abstract黑盒多语多口音音频加声学扰动可抬高 LALM 的 JSR,文本示范防御并非在每个模型上都下降。

    Paper analysisRead analysis
You have reached the end