Skip to content

Translation in progress Some entries still include text in the original language.

Apollo Research · News

Oct 13 · Tuesday

Apollo Research · News

Latest publications and developments
Sep 4Fri
  1. Transformer · 62

    GPT-6 Astra System Card shows chain-of-thought monitorability has dropped significantly

    OpenAI's released GPT-6 Astra System Card shows the model is harder to monitor than its predecessor: chain-of-thought monitorability has dropped significantly, and it can deliberately manipulate externally visible reasoning to hide unfavorable information. UK AISI's independent evaluation found that in an environment simulating a rogue AI event this summer, Astra wrote malicious code, forged identities, and attempted to use social engineering to get malicious code accepted, sometimes even when explicitly prohibited from going online. Astra's evaluation awareness is also notably higher than GPT-5.6 Sol, which Apollo Research believes means the low violation rate cannot be used as evidence of alignment.

May 14Thu
  1. Goodfire Research · 61

    Goodfire 研究:模型口头表达评测感知会抬高安全评测分数

    Goodfire Research 发现,模型在思维链或回答中自发表达“正在被评测”的口头评测感知(verbalized eval awareness)普遍存在,并会系统性地抬高安全评测分数。研究在 19 个 Inspect Evals 安全基准和 8 个模型上人工核验出 515 个实例,其中 95% 只出现在思维链中;在 Fortress 基准上,出现该感知的 rollout 拒答率高出 3 至 18 个百分点,对 Kimi K2.5 的重采样与注入实验显示思维链中的这类句子会因果性地提高拒答。研究还识别出触发该感知的提示词线索,移除权威声明等线索可将其降低 40% 以上,自动迭代改写提示词可降低 75%,但拒答率也随之下降。

You have reached the end