Select any value within a category; different categories must all match. Counts include the other filters you have selected.Another 232papers have no tags yet and are not included in filtered results.

Layer：Prompt layer System component：Memory System component：Monitors System component：Audio System component：Video Clear all

Another 232papers do not have category tags yet and are not included in filtered results.

DefensesarXiv 2610.13733Oct 9
KVeil: First-Place Solution for the ECCV 2026 LifeGenIP Unlearnable Video Challenge
Propose KVeil, which adds perturbations to face videos to prevent unauthorized customization from reproducing identity
arXiv
2610.13733
Published
Oct 9
Layer
Prompt layer
Setting
Models and APIs
Attacker
White-box, Black-box
Evaluated models
Wan2.2-TI2V-5B, HunyuanVideo-1.5, Kling 3.0 and others4
- AttacksMalicious use
- ComponentImage generation
AbstractKVeil adapts LETHE's reference-reading disruption to the challenge's two stages, ranking first on the leaderboard in both Final columns.
Paper analysisRead analysis
AttacksarXiv 2610.08331Oct 6
STCA：研究者提出针对自动驾驶视频 VLM 的时空一致性对抗攻击
提出 STCA，对驾驶视频 VLM 构造可迁移的时空对抗扰动
arXiv
2610.08331
Published
Oct 6
Layer
Prompt layer
Setting
Models and APIs
Attacker
No-box (offline transfer)
Evaluated models
Video-LLaVA-7B, Qwen2.5-VL-7B, Dolphins
- AttacksDetection evasion
- TechniqueGradient and representation optimization
- ComponentVideo
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2610.07939Oct 6
CCDF dataset: Grok Imagine, Veo 3.1, Sora 2 forge surveillance footage, ten deepfake detectors basically cannot recognize it
提出监控深伪基准 CCDF，在统一编码后评测检测器对伪造犯罪事故录像的识别
arXiv
2610.07939
Published
Oct 6
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
C2P-CLIP, ForgeLens, D3-Im and others10
- DefensesDetection and filtering
- AttacksDetection evasion
- ComponentGuardrails and judges
Abstract提出消除格式捷径的监控深度伪造基准 CCDF，揭示现有检测器难以识别商用生成视频。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2610.05818Oct 5
研究显示 VLA 模型文本护栏漏检隐含危害指令
评测文本守卫与激活探针能否拦住机器人隐含伤害指令
arXiv
2610.05818
Published
Oct 5
Layer
Prompt layer
Setting
Embodied systems and robotics
Evaluated models
π0.5, OpenVLA-OFT, Llama Guard 3 and others10
- RiskDangerous agent actions
- ComponentGuardrails and judges
Paper analysisRead analysis
Analysis and theoryarXiv 2610.07005Oct 4
研究审计 Qwen2-Audio 音频越狱 AdvWave-P 的频率与解码层归因
遮挡审计 AdvWave-P 音频越狱的频带必要性与解码层关联
arXiv
2610.07005
Published
Oct 4
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
Qwen2-Audio-7B-Instruct, LLaMA-Omni
- AttacksJailbreaks
- ComponentAudio
AbstractAdvWave-P 的八频带排序与能量相关。
这是对加性音频越狱 AdvWave-P 的频率与解码器深度审计，受害模型主要是 Qwen2-Audio-7B-Instruct，不提出新攻击。
Paper analysisRead analysis
AttacksarXiv 2609.38899Sep 30
SceneJail: Jailbreaking multimodal large models using video scene context
提出 SceneJail，利用视频情境上下文越狱视频多模态模型
arXiv
2609.38899
Published
Sep 30
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Qwen2.5-VL-7B-Instruct, Qwen2.5-VL-32B-Instruct, Qwen3-VL-8B-Instruct and others8
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentVideo
Paper analysisRead analysis
AttacksarXiv 2609.15989Sep 15
Researchers propose plan injection attack that can bypass chain-of-thought monitoring
提出 plan injection 攻击，植入良性伪装计划以绕过思维链监视器
arXiv
2609.15989
Published
Sep 15
Layer
Prompt layer
Setting
Models and APIs
Attacker
Gray-box
Evaluated models
Qwen2.5-Coder-7B-Instruct, Qwen3-8B, DeepSeek-R1-0528 and others6
- AttacksDetection evasion
- TechniqueReasoning-chain manipulation
- ComponentMonitors
Abstract论文指出模型会将外部上下文中的伪装计划改写为自身推理，使思维链监视器失效甚至反向合理化恶意行为。
Paper analysisRead analysis
DefensesarXiv 2609.05797Sep 5
Paper finds safety monitors mainly block requests the model would already refuse
评估安全监视器并提出双侧梯级微调以减少会答有害请求的漏检
arXiv
2609.05797
Published
Sep 5
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
Gemma-4-31B-IT, Qwen3-32B, Llama Guard 3 8B and others6
- DefensesDetection and filtering
- RiskInappropriate refusal
- ComponentGuardrails and judges
Abstract论文发现安全监视器大多拦截模型已拒答请求，指出明确度偏差是共性原因，并通过双侧梯级微调提升回答请求的召回表现。
Paper analysisRead analysis
AttacksarXiv 2609.01023Sep 1
Akrasia：针对推理型代码 LLM 的隐蔽后门攻击
提出隐蔽后门攻击 AKRASIA，在推理代码模型提示中植入触发器并伪装思维链
arXiv
2609.01023
Published
Sep 1
Layer
Prompt layer
Setting
coding agent
Evaluated models
Claude-Sonnet-5, GPT-5.5, Gemini-3.5-flash and others7
- AttacksPrompt injection
- TechniqueReasoning-chain manipulation
- ComponentReasoning chains
Abstract论文针对推理代码大模型提出了隐蔽推断期后门攻击 AKRASIA，揭示了模型思维链可被利用进行欺骗性伪装的安全隐患。
Paper analysisRead analysis
AttacksarXiv 2608.15578Aug 16
ARENA：面向大型音频语言模型的自动化红队框架
提出 ARENA 音频红队框架，自动构造文本安全且音频接地的越狱输入
arXiv
2608.15578
Published
Aug 16
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Audio Flamingo 3, Qwen2-Audio-7B-Instruct, MiMo-Audio-7B-Instruct and others4
- AttacksJailbreaks
- TechniqueAutomated search
- ComponentAudio
Paper analysisRead analysis
DefensesarXiv 2607.13336Jul 15
TC-UAP：针对图像转视频与微调定制的通用视频保护方法
提出 TC-UAP，用身份级多帧扰动保护视频免被定制复现身份
arXiv
2607.13336
Published
Jul 15
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
LTX-2.3, Wan2.2-5B
- ComponentVideo
AbstractTC-UAP 以可复用的时间一致扰动干扰两类定制共用的 VAE 隐空间。
作者要解决的是：发布前如何给视频加不可见扰动，使片段既不能被拿去微调视频扩散模型，也不能被抽帧做 image-to-video。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2606.06037Jun 4
SpeechJBB：语码转换语音下大型音频语言模型的越狱基准
提出 SpeechJBB，评测语码转换语音下音频语言模型的越狱稳健性
arXiv
2606.06037
Published
Jun 4
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
Qwen2.5-Omni-7B, Qwen3-Omni-30B-A3B-Instruct, Voxtral-Small-24B and others9
- AttacksJailbreaks
- TechniqueEncoding and obfuscation
- ComponentAudio
AbstractSpeechJBB 用五语语码转换语音和伪词探针评测九个 LALM，作者将越狱归为对齐失败而非听不懂。
SpeechJBB 用合成语音测量 LALM 在五语、语码转换和局部伪词混淆下的安全对齐，并另设口语理解对照。
Paper analysisRead analysis
AttacksarXiv 2605.20519May 20
CodecAttack：在音频编解码器潜空间构造对抗扰动，绕过有损压缩防御
提出 CodecAttack，在编解码器隐空间构造可穿透有损压缩的对抗音频
arXiv
2605.20519
Published
May 20
Layer
Prompt layer
Setting
Models and APIs
Attacker
White-box
Evaluated models
Qwen2-Audio-7B-Instruct, Audio Flamingo 3, Qwen2.5-Omni
- AttacksJailbreaks
- TechniqueGradient and representation optimization
- ComponentAudio
Paper analysisRead analysis
AttacksarXiv 2605.18168May 18
研究者提出声学干扰攻击 AIA，可通用越狱 10 个大型音频语言模型
提出声学干扰攻击 AIA，用良性音频潜语义越狱音频语言模型
arXiv
2605.18168
Published
May 18
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Qwen3-Omni, Qwen2.5-Omni, Qwen2-Audio and others10
- AttacksJailbreaks
- ComponentAudio
Paper analysisRead analysis
AttacksarXiv 2604.14604Apr 16
The AudioHijack framework achieves covert audio prompt injection against 13 speech large models
提出 AudioHijack，用不可感知对抗音频对语音模型做上下文无关提示注入
arXiv
2604.14604
Published
Apr 16
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
SpeechGPT, GLM-4-Voice, VITA-Audio and others15
- AttacksPrompt injection
- TechniqueGradient and representation optimization
- ComponentAudio
Abstract提出了 AudioHijack 框架，揭示了 LALM 对听觉提示注入的脆弱性与传统防御的局限。
Paper analysisRead analysis
Evaluation and benchmarksarXiv 2602.10639Feb 11
VideoSTF 揭示视频大模型输出重复问题
提出 VIDEO STF 评测视频大模型输出重复并压力测试时序扰动
arXiv
2602.10639
Published
Feb 11
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
LLaVA-Video-7B-Qwen2, LLaVA-Video-7B-Qwen2-Video-Only, LLaVA-NeXT-Video-7B and others10
- AttacksDenial of service
- ComponentVideo
AbstractVIDEO STF 把输出重复做成可测、可被时间扰动放大、并可黑盒诱导的失败。
VIDEO STF 测量 VideoLLM 的输出重复，并把时间变换用作 black-box 诱导。
Paper analysisRead analysis
AttacksarXiv 2601.23255Jan 31
研究者提出音频叙事越狱攻击
提出音频叙事越狱，以嗓音投递风格绕过端到端语音模型拒答
arXiv
2601.23255
Published
Jan 31
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
GPT-4o Realtime, Gemini 2.0 Flash, Qwen2.5-Omni-7B
- AttacksJailbreaks
- TechniqueRole-play and persuasion
- ComponentAudio
Paper analysisRead analysis
AttacksarXiv 2601.16231Jan 21
SoundBreak: A systematic study of pure audio adversarial attacks against trimodal models
提出 SOUNDBREAK，用仅音频共享对抗扰动使三模态模型答错
arXiv
2601.16231
Published
Jan 21
Layer
Prompt layer
Setting
Models and APIs
Evaluated models
VideoLLAMA2, Qwen 2.5 Omni, Qwen 3 Omni and others4
- TechniqueGradient and representation optimization
- ComponentAudio
Paper analysisRead analysis
AttacksarXiv 2511.10692Nov 12, 2025
StyleBreak：利用风格化音频越狱揭示大型音频语言模型的对齐漏洞
提出 StyleBreak 风格化音频越狱，利用语音属性绕过音频语言模型对齐
arXiv
2511.10692
Published
Nov 12, 2025
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Qwen2-Audio-7B-Instruct, MERaLiON-AudioLLM-Whisper-SEA-LION, Ultravox-v0.4.1-Llama-3.1-8B and others6
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentAudio
Paper analysisRead analysis
AttacksarXiv 2504.01094Apr 2, 2025
研究者提出 Multi-AudioJail
提出 MULTI-AUDIOJAIL，以多语多口音和声学扰动越狱音频模型
arXiv
2504.01094
Published
Apr 2, 2025
Layer
Prompt layer
Setting
Models and APIs
Attacker
Black-box
Evaluated models
Qwen2-Audio, DiVA-llama-3-v0-8b, MERaLiON-AudioLLM-Whisper-SEA-LION and others5
- AttacksJailbreaks
- TechniqueCross-modal payloads
- ComponentAudio
Abstract黑盒多语多口音音频加声学扰动可抬高 LALM 的 JSR，文本示范防御并非在每个模型上都下降。
Paper analysisRead analysis

AI Safety Daily

Read the latest issueOne issue per day, updated as events develop