Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 254 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
评估应用决策层的输入注入与隐私推断风险
Published Oct 4
Evaluated models Jev , NanoJev Abstract Jev 的类型化决策可被输入与训练操纵,也会泄露信息,并同时支持检测与滥用。Jev 是 TypeSafe 的 System One 模型,把应用 state 和固定问题变成 Choice、Noul 或 Score 的类型化决策与概率。作者用官方 API 和可改训练的 NanoJev,考察它作为决策层时的操纵、泄露与双重用途。
诊断护栏相对基座在对抗提示上的置信失校
Published Sep 29
Evaluated models Llama-Guard 7B , Llama-Guard-2 8B , Llama-Guard-3 8B and others10 Abstract 对抗包装使 guard 高置信漏检,而对应 base 在同一输入上常更不确定。诊断性分析 :五个提示词分类 guard 的置信度,在清洁输入上可以较校准,在越狱包装后则变成高置信度的错误判定。
提出 PALS,用潜空间平滑防御全双工语音对话的对抗扰动
Published Sep 23
Evaluated models Moshi-style agent 复现 AgentCF 上的多智能体攻防并刻画连通性作用
Published Aug 4
Evaluated models Qwen3-235B-A22B , Claude Haiku 4.5 , Mixtral 8×7B and others4 Abstract 连通性沿 k 与ρ改变攻防,且用户/物品与早期/稳态需要分开看。作者在 AgentCF 上研究连通性如何改变多智能体协同过滤的攻防,复现已有方法而不是提出新载荷。
用 TEE-REDBENCH 评测 TEE 顾问的机制幻觉与提示诱导失败
Published Feb 23
Evaluated models ChatGPT-5.2 , Claude Opus-4.6 Abstract 作者用 TEE-REDBENCH 测两款顾问,称失败可迁移且流水线控制可降低发生率。TEE-REDBENCH 红队评测被当作 Intel SGX 与 Arm TrustZone 安全顾问的 ChatGPT-5.2 和 Claude Opus-4.6,看架构推理、远程证明语义、缓解建议和策略约束下的拒答,并测提示诱导失败能否跨助手迁移。作者把助手看成随机策略。
提出 MalURLBench 评测 Agent 是否接受结构伪装的恶意 URL
Published Jan 26
Evaluated models GPT-3.5-Turbo , GPT-4o-mini , GPT-4o and others13 You have reached the end