Skip to content

Translation in progress Some entries still include text in the original language.

#arXiv

No new updates indexed today yet

Page 18 Newer contentBack to latest

Sep 17Thu
  1. arXiv:越狱、提示注入、投毒与防御 · Indexed · Original Paper59

    红队测试 Auto Mode:用注入与多上下文攻击绕过编码 Agent 阻断监控器(original, opens in a new tab)

    Anthropic Fellows 项目的研究者提出 Auto Mode ++,加固编码 Agent 阻断监视器。

    Why it was selected论文给出针对 Claude Code Auto Mode 与 Codex Guardian 的多种绕过机制与成功率,并展示加固后的召回提升与延迟代价。

  2. arXiv:对齐、欺骗与监督 · Indexed · Original Paper53

    Using internal representation monitoring to detect and discover reward hacking in LLM evaluations(original, opens in a new tab)

    Using internal representation probes to monitor and detect reward hacking in evaluations.

    Why it was selectedThe paper uses an extremely simple mean difference probe to locate the reward hacking direction inside open-source frontier models, and provides a cost and recall comparison with LLM monitors.

Sep 16Wed
  1. Owain Evans · Indexed · Original X44

    新论文:仅用人类故事训练,助手仍会习得角色的怪癖行为(original, opens in a new tab)

    Owain Evans 等人发布新论文,用只包含人类、不含 AI 的合成故事训练模型,发现助手在普通对话中会习得故事角色的怪癖行为,且来自精英学校角色的行为被习得的程度更强。作者表示论文中给出了一些解释,并与 Roger Grosse 等人关于影响函数(influence functions)的工作相关联,希望获得对该效应的讨论。

    Quoted postOwain Evans@OwainEvans_UK

    New paper: We trained models on synthetic stories about humans only (no AIs).
 We found the Assistant adopts quirky behaviors from the stories in ordinary chat. Surprisingly, adoption was stronger for characters from elite schools! Why does this happen? 🧵

  2. Failure-First · Indexed · Original News29

    临床路径作为医院病房中 Physical AI 的安全规范(original, opens in a new tab)

    Franchini 等人提出将标准化医疗流程——Clinical Pathways(CPs)重新诠释为可用数学表达的执行期安全规范,替代依赖统计异常检测的传统做法,以避免缺乏可解释性和审计性的问题。该概念架构由传感子系统、具身子系统与边缘云子系统三部分组成,其中机器人(参考实现为 TIAGo Pro)充当主动传感器而非静态网关,Runtime Safety Monitor(RSM)基于信号时序逻辑(STL)中的 Always 算子与 Bounded Eventually 算子在执行期检查约束并返回实值鲁棒度。

  3. Owain Evans · Indexed · Original X45

    研究:LLM 助手更易受与自身相似的故事角色影响(original, opens in a new tab)

    Owain Evans 等人发现,LLM 助手更容易受故事中与自身相似的人类角色影响,例如礼貌且乐于助人的角色就像 Claude。团队仅用关于人类、不含 AI 的合成故事训练模型,结果助手在普通对话中会习得故事里的古怪行为,且来自精英学校角色的行为被采纳得更强。作者指出,用故事训练时,重要的不只是角色做了什么,还有角色与助手有多相似。

    Quoted postOwain Evans@OwainEvans_UK

    New paper: We trained models on synthetic stories about humans only (no AIs).
 We found the Assistant adopts quirky behaviors from the stories in ordinary chat. Surprisingly, adoption was stronger for characters from elite schools! Why does this happen? 🧵

Sep 15Tue
  1. 论文追踪 · Indexed · Original Paper57

    Researchers propose plan injection attack that can bypass chain-of-thought monitoring(original, opens in a new tab)

    斯坦福与 CMU 的研究者提出 plan injection 攻击,植入良性伪装计划以绕过思维链监视器。

    Why it was selected论文提出把伪造推理链注入模型上下文即可让模型照单全收并规避思维链监控,做 CoT 监控的团队可据此重新评估监控假设。