Translation in progress Some entries still include text in the original language.
Oct 12 · Monday
Another 305 papers do not have category tags yet and are not included in filtered results.
“
About this collection Collection in progress We are building a large AI safety paper collection to help researchers find work related to their interests. Papers are collected automatically andfiltered only for relevance to AI safety , without judging quality, novelty or reading value. The default “Annotated first” shows papers with tags or published paper analyses first. Each group is ordered by original publication date, newest first, with undated papers last. “Newest first” uses publication dates only. This order is not a quality ranking.
One-line summaries, tags and paper analyses are prepared by AI from the papers. Language models may have systematic biases and produce hallucinations.We plan to carry out human annotation and review to reduce errors in this content.
提出 MIST 压力测试,检验无关图像是否扰动 VLM 评判者标签
Published Sep 29
Evaluated models GPT-5.2 , Gemini 3.1 Flash-Lite , Gemini 3.5 Flash and others13 Abstract 有图就改标签,图的内容却不告知 judge,裁决绑定配置。作者用MIST 问:VLM 代替人类标注时,可替代性裁决会不会被指南要求忽略的图像改写。
评测 System One 模型对 Agent 安全输入的分类可靠性与校准
Published Sep 27
Evaluated models Jev 1.13 , Laya, English checkpoint , Decider, approximately 2B and others4 Abstract 离线评测表明,安全判定的总体分数和校准不能代替分组误差和带预算的自动决策检查。Liu 离线评测 System One 模型能否为智能体安全输入给出可自动化的概率决策。问题是分类是否可靠,以及概率能否在指定漏检和误拦上限内支持放行、拦截或复核。
提出 HPAA 攻击,用排版视觉线索绕过内容审核系统
Published Jun 9
Evaluated models Llama-Guard-3-8B , Perspective API , ShieldGemma-2B and others13 Abstract 揭示了排版视觉线索与分词差异带来的审核盲区,HPAA 以极低查询实现近乎完全规避。这篇论文研究了人类视觉感知与大模型分词处理机制之间的差异所导致的内容审核漏洞 。
提出 BITE,用上下文赌博机选择风格修改抬高 LLM 评委打分
Published May 24
Evaluated models o3-mini , Gemini-2.5-Flash , Llama-3.3-70B-Instruct and others8 Abstract BITE 用黑盒赌博机利用风格偏差抬分,作者称这对 LLM-as-a-judge 构成威胁。BITE 是黑盒风格操纵:在保持答案语义的同时,抬高 LLM 评审给出的分数。
提出 HASTE,挖掘 hard negative 再训练恶意提示检测器
Published Jan 27
Evaluated models protectai/deberta-v3-base-prompt-injection Abstract HASTE 用 hard negative 再训练检测器。HASTE 是检测器侧的闭环硬化框架:持续构造能绕过当前检测的对抗提示,再用来更新恶意提示分类器。
You have reached the end