Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 233 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
证明无显式危害的图文窄微调可诱发跨任务涌现未对齐
Published Sep 28
Evaluated models GPT-4o , GPT-4.1 , Gemini 2.5 and others15 Abstract 证实窄多模态微调可引发全面的多渠道未对齐行为转变,揭示了后训练阶段对齐被隐蔽重塑的安全隐患。论文系统探究了视觉-语言模型中由窄任务微调诱发的跨模态涌现未对齐(Emergent Misalignment, EM)现象。
构建 AGENTTELL 基准,测量浏览器 Agent 的行为侧信道隐私泄露
Published Sep 27
Evaluated models Claude Sonnet 5 , Gemini 3.7 Flash , GPT-5.6 Luna and others6 Abstract 论文评估了浏览器智能体的行为侧信道泄露风险,并基于近万次会话提供了评测数据。
提出 CAVEAT 基准,评测激励失配市场中计算机使用 Agent 的购买决策退化
Published Sep 23
Evaluated models GPT-5.6-Sol , GPT-5.6-Terra , GPT-5.6-Luna and others14 Abstract 提出 CAVEAT 基准揭示智能体在商业偏好下的决策退化,诊断出三类失效并给出缓解方案。
测量任务无关说服对 Agent 编码与网页研究行为的影响
Published Feb 1
Evaluated models gpt-4.1-nano , mistral-nemo-12b , llama-3.1-8b Abstract 任务无关说服会在轨迹上留下任务相关的行为痕迹,但立场易感性不能稳定预测其幅度。这篇工作测量一件事:与任务无关的说服进入对话之后,AI 智能体执行后面的编码或网页研究时,轨迹是否系统性不同,以及“更容易被说服”能否预测差有多大。
构建评测 Web Agent 安全与策略遵守的基准 ST-WebAgentBench
Published Oct 9, 2024 You have reached the end