Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
All papers Found 21 papers Another 254 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出利用路由元数据推断敏感话题的侧信道攻击
Published Oct 7
Evaluated models RouteLLM (BERT router) , notdiamond-0001 , Vela (vLLM Semantic Router) Abstract 论文揭示并测量了 LLM 路由决策在无文本日志中的敏感话题泄露,验证了按类别公平性防御的有效性与边界。
提出 PERSISTBD,发布前强化供应链后门使其经良性 SFT 与 RL 后仍外发凭据
Published Oct 6
Evaluated models Qwen2.5-Coder-3B-Instruct , Qwen2.5-Coder-7B-Instruct , Qwen3-Coder-30B-A3B-Instruct Abstract 总结了论文关于后门在 SFT/RL 中存活的发现、两因子机制、PERSISTBD 方法与核心数字。本文研究第三方 LLM 智能体在开发者进行良性监督微调(SFT)和强化学习(RL)后训练时的后门持久性风险。
量化片外功耗测量对隐藏算力的约束能力
Published Oct 6 Abstract 作者称功耗单独只能弱约束隐藏算力。这篇工作定量估计片外功耗能为算力核验排除多少未声明运算。
提出 TRANSCOPE,用 CPU 硬件计数器推断训练集成员
Published Oct 6
Evaluated models BERT (4.4M-340M) , ViT (22M-307M) , Pythia (70M-2.8B) and others5 Abstract TRANSCOPE 揭示了分词器在嵌入表引发的硬件访问局部性差异,证实微架构计数器可突破恒定时间与置信度遮蔽防御。
提出利用共享冷却的跨租户干扰攻击,并设计租户隔离机制
Published Oct 4 Abstract 揭示网关共享冷却漏洞,提出来源检查与租户隔离防御。
提出 HXAI 分层隐私解释框架,本地保留细解释并只发布加噪摘要
Published Oct 2
Evaluated models gradient-boosted tree regression models Abstract HXAI 把无噪声局部 SHAP 留在家庭内,只聚合差分隐私摘要。HXAI 是面向分布式能源系统的分层隐私保护解释框架,服务规划、监测与诊断,而不是实时控制。
提出 MIRROR,用多路径摘要多数表决保障多智能体通信完整性
Published Oct 2
Evaluated models Gemma-4-31B-it , Gemini 2.5 Pro Abstract MIRROR 靠多数路径。MIRROR 是 LLM 多智能体通信层上的多路径法定人数完整性原语,只处理不透明字节,不解释消息内容。要处理的是 Agent-in-the-Middle:中介合法终结 TLS 后可改在途消息,而语义校验有推理开销和误拦,签名又要求私钥管理。做法是生成结束后复制同一规范化载荷。
提出只训练或篡改多智能体潜在通信链路来提高有害遵从
Published Sep 30
Evaluated models Llama-3.2-3B-Instruct , Qwen2.5-3B-Instruct , Gemma-3-1B-IT and others7 Abstract 潜在链路本身即可改变冻结智能体系统的安全,奖励既能攻击也能修复。学习得到的潜在通信链路会改变由冻结、对齐智能体组成的系统是否遵从有害请求。 。作者研究三种拓扑:双智能体、三级顺序协作,以及双专家加汇总。
用 SCM 合成会话并训练检测器识别推理层滥用
Published Sep 29
Evaluated models gradient-boosted detector (GBDT/XGBoost) 提出检索器后门攻击操纵智能体搜索,并用 DOU 逃避检测
Published Sep 26
Evaluated models E5 , Contriever-MSMARCO Abstract 论文展示了通过恶意检索器操纵智能体多轮搜索并利用诱饵重塑表征隐蔽后门的可行性与系统风险。
部署蜜罐测量针对暴露 LLM 基础设施的攻击
Published Sep 24 提出 Agent Flight Recorder,为长时程工具智能体构建链上锚定的防篡改审计追踪
Published Sep 2 Abstract 语义事件加哈希链、Merkle 与链上锚定,用来在争议中核验长程智能体的动作序列。Agent Flight Recorder 把长程工具智能体的动作收成可被第三方独立核验的审计记录,面向运营方本身可能改写历史的争议。
Propose GIFT, isolating user data in shared LLM serving using encryption and GPU information flow tracking
Published Aug 26
Evaluated models Qwen2.5-14B , Qwen2.5-32B , Qwen2.5-72B and others6 Abstract GIFT uses cryptographic isolation plus GPU information flow rules to enforce user data isolation on vLLM and DistServe, and reports throughput overhead.GIFT is the authors' user data isolation system for shared LLM serving, with GIFT-CC enabling confidential computing. In the conclusion, the authors state it is the first IFT design for this scenario.
Proposing KeyPooling to measure where API relays break prompt cache isolation
Published Aug 18
Evaluated models grok-4-fast-non-reasoning , grok-4-1-fast-non-reasoning , grok-3 and others11 Abstract Shared upstream credentials place relay customers in the same cache domain; preserving identity or separate principals can separate them.KeyPooling measures where LLM API relays drop customer identity, causing prompt caches to no longer be isolated per downstream customer.
提出 SYNCHAIN,诱导计算机使用 Agent 自建跨任务持久攻击链
Published Aug 7
Evaluated models Qwen3.5-9B , Llama-3.1-8B , Ministral-3-8B Abstract 论文揭示了 CUA 自合成工件带来的内部供应链威胁,验证了潜伏载荷的跨任务传播能力与防御局限。
构造可通过计费审计的 token 虚报,使服务商系统性超收
Published May 28
Evaluated models PALACE domain-adapted auditor Abstract 不诚实提供方可在三种 token 审计上虚报并通过检查,作者认为需改用提供方不控制的证据。不透明 LLM 的按 token 计费里,现有审计核验的是提供方可控的证据,不诚实提供方可以虚报并通过检查。 。
提出 SeedHijack,劫持采样 PRNG 以强制选定 token
Published May 8
Evaluated models GPT-2 (124M) , Qwen2-1.5B-Instruct , DeepSeek-R1-1.5B and others5 Abstract 采样层 PRNG 被替换以强制选 token。SeedHijack 把 LLM 采样用的 PRNG 输出换成攻击者选定的数,从而指定下一个 token。权重、输入和 logits 都不改。防御是用硬件 QRNG 替换该随机源。
提出 PrefixWall 选择性隔离共享前缀以缓解计时侧信道
Published Mar 11
Evaluated models gemma-3-4b-it , llava-onevision-qwen2-0.5b-ov-hf , llava-onevision-qwen2-7b-ov-chat-hf and others9 Abstract PrefixWall 用缓存元数据按需切断跨用户前缀延续,以保留 APC 并限制 TTFT 侧信道。PrefixWall is a system-level defense for multi-tenant LLM services that limits the TTFT side channel of Automatic Prefix Caching while preserving prefix reuse.
提出 OPTILEAK,经 KV 缓存侧信道逐 token 重建他人提示
Published Feb 24
Evaluated models Qwen-2.5-3B-Instruct , Qwen-2.5-7B-Instruct , Qwen-2.5-14B-Instruct and others4 Abstract OPTILEAK 用 SFT 与 hard-token DPO 降低每 token 请求数,作者称缓存提示泄露的风险高于先前报告。
为去中心化 LLM 推理网络提出稳健成本感知 PoQ,抵御恶意评估者操纵分数
Published Jan 29
Evaluated models llama 3 2 3b , gemma 2 2b it , tinyllama 1 1b and others10 Abstract 成本感知 PoQ 加入稳健共识。这篇扩展工作把成本感知 Proof of Quality 的共识层改成能承受恶意评估分数的形式,奖励仍同时看输出质量与延迟成本。