Skip to content

Translation in progress Some entries still include text in the original language.

Oct 12 · Monday

All papers

Found 23 papers
Filter4

Attack type

Jailbreaks11

Attack technique

Gradient and representation optimization5Automated search3Cross-modal payloads9

Impact

Harmful content11Output manipulation6

System type

Models and APIs17LLM applications3AI Agent3

Attacker access

Black-box8

Attack surface / entry point

User input7Images, audio and video19

Layer

Prompt layer17Model layer18Application layer6Training and data layer7

System component

MCP and skills84Memory80RAG49Guardrails and judges140Monitors64Reasoning chains27Permissions and sandboxing92Fine-tuning and open weights7Vision89Audio17Video6Image generation20Embeddings8Multimodal126
Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 232papers have no tags yet and are not included in filtered results.
Layer：Prompt layerLayer：Application layerSystem component：AudioSystem component：VideoClear all

Another 232papers do not have category tags yet and are not included in filtered results.

  1. DefensesarXiv 2610.13733

    KVeil: First-Place Solution for the ECCV 2026 LifeGenIP Unlearnable Video Challenge

    Propose KVeil, which adds perturbations to face videos to prevent unauthorized customization from reproducing identity

    arXiv
    2610.13733
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Attacker
    White-box, Black-box
    Evaluated models
    Wan2.2-TI2V-5B, HunyuanVideo-1.5, Kling 3.0 and others4

    AbstractKVeil adapts LETHE's reference-reading disruption to the challenge's two stages, ranking first on the leaderboard in both Final columns.

    Paper analysisRead analysis
  4. Evaluation and benchmarksarXiv 2610.07939

    CCDF dataset: Grok Imagine, Veo 3.1, Sora 2 forge surveillance footage, ten deepfake detectors basically cannot recognize it

    提出监控深伪基准 CCDF，在统一编码后评测检测器对伪造犯罪事故录像的识别

    arXiv
    2610.07939
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Evaluated models
    C2P-CLIP, ForgeLens, D3-Im and others10

    Abstract提出消除格式捷径的监控深度伪造基准 CCDF，揭示现有检测器难以识别商用生成视频。

    Paper analysisRead analysis
  5. Analysis and theoryarXiv 2610.07005

    研究审计 Qwen2-Audio 音频越狱 AdvWave-P 的频率与解码层归因

    遮挡审计 AdvWave-P 音频越狱的频带必要性与解码层关联

    arXiv
    2610.07005
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Evaluated models
    Qwen2-Audio-7B-Instruct, LLaMA-Omni
    AbstractAdvWave-P 的八频带排序与能量相关。

    这是对加性音频越狱 AdvWave-P 的频率与解码器深度审计，受害模型主要是 Qwen2-Audio-7B-Instruct，不提出新攻击。

    Paper analysisRead analysis
  8. Evaluation and benchmarksarXiv 2609.35922

    VoxParity 评测：语音智能体在需要听声判断时仍按文字行事

    提出 VoxParity，固定转写只改音频，评测语音智能体是否按行业规则改工具调用

    arXiv
    2609.35922
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    MiMo-V2.6-Pro, gemini-3.7-flash, Qwen3.8-Omni and others15
    AbstractVoxParity 用固定转写的音频对比和 words-only null，测量语音智能体是否按所听内容改变工具调用。

    VoxParity 测量语音智能体在词语不变、只有声音改变时，是否按行业规则改它所执行的工具调用。

    Paper analysisRead analysis
  9. Evaluation and benchmarksarXiv 2609.09404

    MMPIBench：多模态提示注入对六种 Agent 框架的跨框架评测

    用 MMPIBench 评测多模态提示注入对 Agent 框架的影响

    arXiv
    2609.09404
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    Claude Opus 4.8, GPT-5.4, Gemini 3.1 Pro and others6

    Abstract论文提出 MMPIBench 评测多模态提示注入对智能体的影响，发现模型主导行为、尝试远超完成，音频通道缺乏防护。

    Paper analysisRead analysis
  11. DefensesarXiv 2607.13336

    TC-UAP：针对图像转视频与微调定制的通用视频保护方法

    提出 TC-UAP，用身份级多帧扰动保护视频免被定制复现身份

    arXiv
    2607.13336
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Evaluated models
    LTX-2.3, Wan2.2-5B
    AbstractTC-UAP 以可复用的时间一致扰动干扰两类定制共用的 VAE 隐空间。

    作者要解决的是：发布前如何给视频加不可见扰动，使片段既不能被拿去微调视频扩散模型，也不能被抽帧做 image-to-video。

    Paper analysisRead analysis
  12. Evaluation and benchmarksarXiv 2606.06037

    SpeechJBB：语码转换语音下大型音频语言模型的越狱基准

    提出 SpeechJBB，评测语码转换语音下音频语言模型的越狱稳健性

    arXiv
    2606.06037
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Evaluated models
    Qwen2.5-Omni-7B, Qwen3-Omni-30B-A3B-Instruct, Voxtral-Small-24B and others9
    AbstractSpeechJBB 用五语语码转换语音和伪词探针评测九个 LALM，作者将越狱归为对齐失败而非听不懂。

    SpeechJBB 用合成语音测量 LALM 在五语、语码转换和局部伪词混淆下的安全对齐，并另设口语理解对照。

    Paper analysisRead analysis
  15. AttacksarXiv 2604.14604

    The AudioHijack framework achieves covert audio prompt injection against 13 speech large models

    提出 AudioHijack，用不可感知对抗音频对语音模型做上下文无关提示注入

    arXiv
    2604.14604
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Evaluated models
    SpeechGPT, GLM-4-Voice, VITA-Audio and others15

    Abstract提出了 AudioHijack 框架，揭示了 LALM 对听觉提示注入的脆弱性与传统防御的局限。

    Paper analysisRead analysis
  17. Evaluation and benchmarksarXiv 2602.10639

    VideoSTF 揭示视频大模型输出重复问题

    提出 VIDEO STF 评测视频大模型输出重复并压力测试时序扰动

    arXiv
    2602.10639
    Published
    Layer
    Prompt layer
    Setting
    Models and APIs
    Evaluated models
    LLaVA-Video-7B-Qwen2, LLaVA-Video-7B-Qwen2-Video-Only, LLaVA-NeXT-Video-7B and others10
    AbstractVIDEO STF 把输出重复做成可测、可被时间扰动放大、并可黑盒诱导的失败。

    VIDEO STF 测量 VideoLLM 的输出重复，并把时间变换用作 black-box 诱导。

    Paper analysisRead analysis
  18. AttacksarXiv 2602.07379

    Aegis: Governance, Integrity, and Security for AI Voice Agents

    提出 Aegis 红队框架，多轮攻击高风险语音 Agent

    arXiv
    2602.07379
    Published
    Layer
    Application layer
    Setting
    AI Agent
    Evaluated models
    GPT-4o, GPT-4o-mini, Gemini-1.5 Pro and others7
    AbstractAegis red-teams three types of voice agents: query-based access eliminates authentication and leakage successes, but behavioral attacks remain.

    Aegis uses multi-turn red-teaming evaluation on ALLM voice agents already integrated into business systems. The authors call this the first systematic red-teaming framework in this setting.

    Paper analysisRead analysis
Load more