Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 11 papers Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
评测多轮对话中 GradSafe 越狱检测的可分性与脆弱性
Published Sep 29
Evaluated models Llama 3.1 8B Instruct , Qwen2.5-7B-Instruct Abstract CWS 显示不安全梯度在真实多轮流量中变弱,且随攻击族和模型而变。作者评估梯度越狱检测从单条提示词迁到多轮对话后还剩多少可分性,方法是用 Context Window Scanner 把 GradSafe 原封不动地套到用户轮窗口上。
用词级归因指导同义词替换,翻转提示注入检测并验证越狱
Published Sep 22
Evaluated models Prompt Guard 2 (86M) , Llama 3.1 8B 提出任意字母置换密码越狱,无需微调即可诱导有害输出
Published Sep 9
Evaluated models Claude Sonnet 4 , Claude Sonnet 4.5 , Gemini 3 Flash (preview) and others7 Abstract 前沿大模型无需微调即可通过提示词学会字母置换密码,进而绕过分类器与对齐,作者呼吁关注能力提升带来的安全风险。
提出 LogInject 框架,评测日志分析中的被动提示注入及缓解
Published Jul 16
Evaluated models GPT-4o , Claude 3.5 Sonnet , Llama-3-70B-Instruct Abstract 论文评估了 LLM 日志分析中的上下文污染风险,提出分片拼接等攻击与三层防御,指出必须结合架构隔离与人工介入。
提出针对 Agent 护栏的推理扩展拒绝服务攻击
Published Jun 12
Evaluated models TS-Guard-8B , Qwen3.5-9B , DeepSeek-V3.2 and others11 构建 MultiTurnPSB,评测四轮医疗越狱与分类器输入防御
Published May 30
Evaluated models GPT-4.1-mini , Claude Sonnet 4.5 Abstract 多轮攻击加剧医疗模型风险,分类器干预有效但受高误报率制约。MultiTurnPSB 针对患者端医疗大模型在持续交互中的安全风险,构建了包含三种攻击模态的四轮对抗评测基准。
Using ADVERSA to measure guardrail degradation and reviewer reliability under multi-turn attacks
Published Mar 10
Evaluated models Claude Opus 4.6 , Gemini 3.1 Pro , GPT-5.2 Abstract ADVERSA measures multi-turn guardrail changes using per-turn compliance trajectories and three-reviewer consensus.ADVERSA is an automated multi-turn red-teaming measurement framework that records guardrail behavior as per-turn compliance trajectories and simultaneously measures whether reviewers agree. The problem it addresses: single-turn binary pass/fail cannot show how safety properties change under sustained adversarial pressure, nor can it separate gradual refusal consolidation from stable scores. The authors argue that real-world adversaries rewrite and persist over multiple turns.
提出多轮多模态越狱,并用 FragGuard 拦截有害响应
Published Jan 9
Evaluated models LLaVa-1.6 (7B) , LLaVa-1.6 (13B) , Qwen-2-7B and others5 Attacks arXiv 2511.16110 · Nov 20, 2025 提出 MFA 框架,协同突破视觉语言模型的对齐、提示与审核层
Published Nov 20, 2025
Evaluated models MiniGPT-4 , LLaMA-4-Scout-Inst , LLaMA-3.2-11B-Vision-Instruct and others17 Abstract 作者称多层防御的 VLM 仍存在跨模型漏洞,MFA 整合三项技术实现了端到端越狱。
Attacks arXiv 2510.11570 · Oct 14, 2025 提出四种阶段转换攻击,绕过推理模型的安全推理护栏
Published Oct 14, 2025
Evaluated models gpt-oss-20b , gpt-oss-120b , Qwen3-4B-Thinking-2507 and others10 Attacks arXiv 2510.10271 · Oct 12, 2025 提出 MetaBreak,用特殊 token 操纵越狱在线 LLM 服务并绕过审核
Published Oct 12, 2025
Evaluated models Llama-3.3-70B-Instruct , Qwen-2.5-72B-Instruct , Gemma-2-27B-Instruct and others10 Abstract 利用特殊 token 注入对抗平台模板包裹与审核,多场景验证了越狱有效性与互补性。
You have reached the end