Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 232 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 ARENA 音频红队框架，自动构造文本安全且音频接地的越狱输入
Published Aug 16
Evaluated models Audio Flamingo 3 , Qwen2-Audio-7B-Instruct , MiMo-Audio-7B-Instruct and others4 提出嵌入推断攻击 EIA，在黑盒 IR 中识别所用嵌入模型
Published Jul 1
Evaluated models e5-small , e5-small-v2 , e5-base and others19 Abstract EIA 用无序文档集的差异从候选中识别嵌入模型，并给出 reranker 与阈值下的计数。EIA 是在黑盒 IR 上识别所用嵌入模型的攻击。 。
提出 SpeechJBB，评测语码转换语音下音频语言模型的越狱稳健性
Published Jun 4
Evaluated models Qwen2.5-Omni-7B , Qwen3-Omni-30B-A3B-Instruct , Voxtral-Small-24B and others9 Abstract SpeechJBB 用五语语码转换语音和伪词探针评测九个 LALM，作者将越狱归为对齐失败而非听不懂。SpeechJBB 用合成语音测量 LALM 在五语、语码转换和局部伪词混淆下的安全对齐，并另设口语理解对照。
提出声学干扰攻击 AIA，用良性音频潜语义越狱音频语言模型
Published May 18
Evaluated models Qwen3-Omni , Qwen2.5-Omni , Qwen2-Audio and others10 提出 Aegis 红队框架，多轮攻击高风险语音 Agent
Published Feb 7
Evaluated models GPT-4o , GPT-4o-mini , Gemini-1.5 Pro and others7 Abstract Aegis red-teams three types of voice agents: query-based access eliminates authentication and leakage successes, but behavioral attacks remain.Aegis uses multi-turn red-teaming evaluation on ALLM voice agents already integrated into business systems. The authors call this the first systematic red-teaming framework in this setting.
Attacks arXiv 2512.01335 · Dec 1, 2025 提出 EmoRAG，向查询与知识库注入同一表情以劫持 RAG 检索
Published Dec 1, 2025
Evaluated models SPECTER , Contriever , Qwen2-7B and others11 Abstract EmoRAG 用表情联动查询与库文本。EmoRAG 测量 RAG 对符号扰动的反应：同一表情同时出现在查询和库文本里时，检索会偏离语义匹配。作者要检查的是，检索是否真由语义相关性决定。
Attacks arXiv 2511.10692 · Nov 12, 2025 提出 StyleBreak 风格化音频越狱，利用语音属性绕过音频语言模型对齐
Published Nov 12, 2025
Evaluated models Qwen2-Audio-7B-Instruct , MERaLiON-AudioLLM-Whisper-SEA-LION , Ultravox-v0.4.1-Llama-3.1-8B and others6 Attacks arXiv 2504.01094 · Apr 2, 2025 提出 MULTI-AUDIOJAIL，以多语多口音和声学扰动越狱音频模型
Published Apr 2, 2025
Evaluated models Qwen2-Audio , DiVA-llama-3-v0-8b , MERaLiON-AudioLLM-Whisper-SEA-LION and others5 Abstract 黑盒多语多口音音频加声学扰动可抬高 LALM 的 JSR，文本示范防御并非在每个模型上都下降。
You have reached the end