Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 11 papers Another 232 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出义务识别基准 ObligationBench,并训练护栏识别 Agent 未履行的安全义务
Published Oct 8
Evaluated models ObligationGuard , Claude-Opus-4.8 , GPT-5.6-Sol and others17 Abstract 义务是护栏缺口。作者认为编码智能体的安全不能只靠拦截禁止动作,还要找出终止时仍未做的安全关键动作,并将其称为义务。
提出流匹配逆向框架,从多向量视觉文档索引重构页面
Published Oct 7
Evaluated models Tomoro-ColQwen3-8B , ColQwen3.5-4.5B , Tomoro-colqwen3-embed-4b and others13 提出红蓝对抗评测平台 ACEA,分开计量攻击强度与防御效果
Published Sep 8
Evaluated models openai/gpt-4o , google/gemini-2.5-pro , google/gemma-3-27b-it and others5 Abstract ACEA 用 ASAP 让红蓝对同一目标对打。ACEA 是让可插拔红队和蓝队共享一个目标 LLM 的对打场地,把攻击强度和防御效果分开记分。作者要补三处空缺:双方只能对着固定对手分开练。LLM judge 分不清真实泄露和幻觉,拦截后又看不到攻击有多强。
提出 PMA,用流形对齐从 E2EO 混淆向量恢复明文
Published Sep 7
Evaluated models BERT-base , RoBERTa-base , T5-base and others6 Proposes SHAQ, which replaces document embeddings with shadow query embeddings to defend against embedding inversion.
Published Sep 4
Evaluated models GTR-T5 encoder , DPR Abstract SHAQ replaces document embeddings with shadow query embeddings.SHAQ is a defense against EIA for cloud vector databases: instead of directly modifying document embeddings, it replaces them with shadow query embeddings.
提出 CompoSkill,将逐个通过扫描的技能编排为攻击链
Published Aug 17
Evaluated models GPT-5.4 , Gemini-3.1-flash , DeepSeek-V4 and others4 Abstract 论文分析了智能体技能组合风险,指出单包安全认证状态不具备可组合性,需转向路径级防护。
提出嵌入推断攻击 EIA,在黑盒 IR 中识别所用嵌入模型
Published Jul 1
Evaluated models e5-small , e5-small-v2 , e5-base and others19 Abstract EIA 用无序文档集的差异从候选中识别嵌入模型,并给出 reranker 与阈值下的计数。EIA 是在黑盒 IR 上识别所用嵌入模型的攻击。 。
提出 SkillVetBench 评估开源 Agent 技能的多维安全风险
Published Jun 15
Evaluated models Qwen2.5-14B-Instruct , Qwen2.5-32B , Llama-3.1-70B and others6 Abstract 公开排行榜用 LLM-as-Judge 给技能分列 SARS 与 CVSS,并对照市场官方审查。
提出 CFD 跨会话分解攻击,利用工件来源缺口绕过工具型 Agent 的本地检查
Published Jun 8
Evaluated models GPT-4.1 , GPT-5-nano , Claude-3.5-Sonnet and others6 Abstract CFD 用无指令 artifact 把越狱拆到跨会话。CFD 针对工具型 LLM 智能体:利用 artifact 来源不被跟踪这一部署失败模式,把有害目标拆开后延迟组合。
测量思维链将提示中 PII 复述进轨迹的泄漏并评测轻量检测器
Published Mar 6
Evaluated models Llama 3.3:70B , Claude Opus , Mixtral 8×22B and others7 Abstract 作者称 CoT 抬高逐字泄漏且随模型与预算而变,检测器也需按模型选择。在“不要复述 PII”的输出策略下,本文用 black-box 协议测量提示词中的 PII 被写回 CoT 与答案的情况,并比较轻量 gatekeeper。
提出 Zero2Text,无需训练地跨域反演文本嵌入
Published Feb 2
Evaluated models GTR-Base , Qwen3-Embedding-0.6B , Text-Embedding-3-small and others4 Abstract 零训练在线对齐可在未知域、无泄漏对时从黑盒 embedding 还原句子。Zero2Text 是一种不训练 decoder、也不使用泄漏文本–向量对的文本 embedding 反演,针对 RAG 向量库在严格黑盒、目标域未知时的还原。
You have reached the end