Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 255 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出闭环激活引导,在扩散语言模型去噪过程中注入定向偏见
Published Oct 5
Evaluated models LLaDA-8B-Instruct , Dream-v0-Instruct-7B , LLaDA-MoE-7B-A1B-Instruct Abstract 通过去噪中间概率反馈动态调节残差流转向,证明扩散语言模型在推理服务栈中存在闭环偏见注入脆弱性。
提出 ReGap,用自生成伪监督微调恢复模型中的隐私关联
Published Oct 1
Evaluated models GPT-2 Small , GPT-2 Medium , GPT-2 Large and others6 Abstract 提出无真实私有监督的恢复攻击 ReGap,实验显示微调可通过自生成数据唤醒模型潜在隐私关联,突显后适应隐私风险。
提出 Fed-ADR,用编排服务器协同操纵梯度攻破联邦学习并检测恢复
Published Sep 23
Evaluated models CNN(MNIST:2 Conv + 3 FC) , CNN(Fashion-MNIST:6 Conv + 1 FC) , ResNet18(CIFAR-10) Abstract Fed-ADR 用 gray-box 编排攻击绕过多种聚合防御,再用 Hessian 一致性检测和窗口内恢复把准确率拉回。Fed-ADR 是一套面向联邦学习的攻击、检测与恢复框架:编排服务器改写合谋客户端的梯度,使参数服务器的现有防御把投毒更新当成良性,同时在发现后用历史梯度把全局模型原地修回来。
提出 INFER+ 信息过载方法,越狱大型视觉语言模型
Published Jul 3
Evaluated models Qwen3-VL-8B , Qwen2-VL-7B , InternVL3.5-8B and others8 Abstract 用图文过载越狱 LVLM。这篇工作用信息过载 越狱 LVLM,而不是靠 OOD 变换隐藏意图。
提出 ASO,用 GRPO 优化视觉风格以放大越狱攻击
Published Jun 1
Evaluated models GPT-4.1-mini , Gemini-2.5-Flash , Qwen3-VL and others6 Abstract 论文揭示了 MLLM 的风格敏感性脆弱面,提出 ASO 框架利用强化学习优化风格触发器,有效放大了现有视觉越狱效果。
Proposes the universal curved mesh patch UCGP, causing cross-task semantic bias in infrared vision-language models.
Published Apr 3
Evaluated models OpenAI CLIP ViT-L/14 , OpenCLIP ViT-B/16 , Meta-CLIP ViT-L/14 and others10 Abstract UCGP uses one shared curved-grid patch to simultaneously lower the classification and open-ended outputs of IR-VLM.UCGP is a universal physical adversarial patch for infrared vision-language models. The question is: can a patch that can be attached and reused across samples cause stable semantic deviations in the infrared visual evidence shared by classification, description, and VQA. The patch is constrained to a low-frequency curved mesh.
提出 CAGE 攻击,在视觉 token 压缩下用图像扰动使预测偏离
Published Jan 29
Evaluated models LLaVA , Qwen2.5-VL , InternVL3-8B and others5 Abstract CAGE 对齐压缩瓶颈后,压缩 LVLM 的稳健准确率低于全 token 编码器攻击。CAGE 研究的是:LVLM 在推理时剪枝或合并视觉 token 之后,对抗稳健性该怎么估。
You have reached the end