Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 240 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 A2A-TIBA,经 A2A 对等任务间接注入并植入常驻回调
Published Sep 30
Evaluated models MiniMax-M3 , deepseek-v4-pro , glm-5.3 and others8 Abstract A2A-TIBA 一次植入后绕过智能体,GDA 用四类结果定位防线,ELA-ITL 把信封标注列为第三层。A2A-TIBA 把间接提示注入和绕过放进 A2A:gray-box 攻击者已能投递任务,诱导目标部署常驻回调程序后,下令和外传不再经过智能体。
评测多轮对话中 GradSafe 越狱检测的可分性与脆弱性
Published Sep 29
Evaluated models Llama 3.1 8B Instruct , Qwen2.5-7B-Instruct Abstract CWS 显示不安全梯度在真实多轮流量中变弱,且随攻击族和模型而变。作者评估梯度越狱检测从单条提示词迁到多轮对话后还剩多少可分性,方法是用 Context Window Scanner 把 GradSafe 原封不动地套到用户轮窗口上。
构建 MultiTurnPSB,评测四轮医疗越狱与分类器输入防御
Published May 30
Evaluated models GPT-4.1-mini , Claude Sonnet 4.5 Abstract 多轮攻击加剧医疗模型风险,分类器干预有效但受高误报率制约。MultiTurnPSB 针对患者端医疗大模型在持续交互中的安全风险,构建了包含三种攻击模态的四轮对抗评测基准。
用 ADVERSA 测量多轮对抗下护栏退化与评审可靠性
Published Mar 10
Evaluated models Claude Opus 4.6 , Gemini 3.1 Pro , GPT-5.2 Abstract ADVERSA 用逐轮合规轨迹和三评审共识测量多轮护栏变化。ADVERSA 是一套自动多轮红队测量框架,把护栏行为记成逐轮合规轨迹,并同时测量评审是否一致。要处理的问题是:单轮二元通过或失败既看不到持续对抗下安全属性如何变化,也分不开拒答逐步巩固和分数保持稳定。作者认为真实使用中的对手会改写并持续多轮。
提出 MM-Plan 多模态越狱框架,自动规划多轮图像编辑以越狱视觉独占目标
Published Feb 5
Evaluated models Llama-3.2-11B , InternVL3-8B , Qwen3-VL-8B and others8 Abstract 作者称全局规划能攻破对单轮攻击更稳的前沿 MLLM。MM-Plan 是面向 Visual Exclusivity 的 black-box 多模态红队方法,并配有人工基准 VE-Safety。
You have reached the end