Translation in progress Some entries still include text in the original language.
Oct 13 · Tuesday
Another 227 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
评测文生图模型的有害内容生成能力与审核检测缺口
Published Oct 5
Evaluated models SDXL , Stable Diffusion 3.5 Large , FLUX.1-dev and others12 构建 AGENTDOXX 基准,评测联网搜索 Agent 对匿名访谈的再识别
Published Oct 5
Evaluated models GPT-5.6 Terra , GPT-5 Mini , GPT-4.1 Mini and others10 Abstract 论文提出了已知身份的重识别基准 AGENTDOXX,揭示搜索与记忆双重风险及现有防御在检索轨迹中的泄露漏洞。
提出 VEX-Bench 评测 LLM 生成虚假信息的核查复杂度
Published Sep 28
Evaluated models Claude Sonnet 4.5 , Gemini 3.1 Pro , GPT-5.4 and others7 Abstract VEX-Bench 用筛查时的五维复杂度衡量虚假信息对核查容量的占用,并报告生成与核查的成本差。VEX-Bench 把 LLM 虚假信息的风险从“能否生成”改成“筛查时会占用多少核查容量”。
提出 SDLP 与 GRPO,训练模型遵循上下文水印指令
Published Aug 29
Evaluated models GPT-5.4 , GPT-5.4-mini , GPT-5.4-nano and others14 提出 Agent MechSuits,对多轮 CLI Agent 做步级检测与子空间转向
Published Jun 22
Evaluated models LLaMA-3.1-8B , Qwen-2.5-7B , Gemma-2-9B Abstract 白盒步级探针加稀疏转向可压低三模型恶意动作,同时提高生成崩溃率。Agent MechSuits 是面向多轮 CLI 智能体的白盒、步级表示防御,并配有可执行轨迹基准 MAS。
提出 AgentHazard 基准,评测计算机使用智能体的执行层有害行为
Published Apr 3
Evaluated models Qwen2.5-72B-Instruct , Qwen2.5-Coder-32B-Instruct , Qwen3-32B and others12 Abstract AgentHazard 评估了计算机使用智能体的执行安全,作者认为模型层对齐无法可靠保障智能体层面的安全性。AgentHazard 是针对计算机使用智能体执行层安全构建的评估基准,重点探究多步工具调用下局部合理动作累积引发的危害。
提出 LFT 多轮框架,评测模型对欺诈与网络犯罪的可执行协助
Published Feb 25
Evaluated models Claude Sonnet 3.5 , Claude Sonnet 3.7 , Claude Sonnet 4 and others14 Abstract 作者称低努力文本诱导下,多轮 LFT 中模型对三类犯罪的信息协助有限。作者给出一套由执法与政策专家校验的多轮评测,用来估计文本模型经由信息提供,对欺诈和网络犯罪有多少可执行协助。
提出 ChartAttack,用恶意提示驱动代码模型生成误导图表
Published Jan 19
Evaluated models Claude-4.6-Sonnet , GPT-4o , Gemini-2.5-Flash and others20 Abstract ChartAttack 生成不改数据的误导图,降低 MLLM 与人类的图表问答准确率。ChartAttack 研究恶意提示能否让 MLLM 在不改数据的情况下生成误导图表,并量化这些图对其他 MLLM 和人类图表问答的影响。
提出 SafeArena 基准,评测网页 Agent 是否执行故意有害任务
Published Mar 7, 2025
Evaluated models GPT-4o , Claude-3.5-Sonnet , Qwen-2-VL-72B and others5 Abstract SafeArena 用配对任务和 ARIA 评测网页智能体的故意滥用。SafeArena 评测自主网页智能体是否会执行用户故意给出的恶意网页任务。 。
You have reached the end