跳到正文
原文
Mikita Balesni· @balesni · X·本站收录· 原文发表· 治理 →· 扫描记录里的位置 →精选关注度59

OpenAI 宣布与 METR 等机构开展嵌入式评估,其前员工称条款未达 Altman 员工级访问承诺

AI 导读

OpenAI 宣布与 METR、Apollo Research、Transluce、Goodfire 开展第一阶段嵌入式评估,让外部专家深入接触内部模型与系统以研究对齐、测试护栏。前 OpenAI 员工 Mikita Balesni 称,条款未达到 Sam Altman 公开承诺的员工级访问:评估者无 Slack 权限(OpenAI 安全讨论主要在 Slack 进行);由 OpenAI 指定可接触的员工;员工向评估者反映的担忧即使不含机密也不得公开,评估者不得引用员工言论;部分评估机构被禁止发布仅内部使用模型的任何结果,他称其中包括导致 Hugging Face 事件的模型。Balesni 称各参与机构自己也表示条款低于其此前提议的范围,并提醒时间紧迫。

推荐理由

离职员工的第一手观察逐项对照 Altman 公开承诺与已公布条款的差距,可作审视外部评估独立性的参照。

正文 · 原文

The week of my departure from OpenAI, I saw external auditors negotiating with OpenAI over small improvements to access and scope to the company's safety-relevant information, and asked my colleagues “Why are we having these conversations at all?” — @sama already publicly committed to continued, employee-like access for external assessors — and these negotiations sounded not even close. Nobody had a good answer.

Today, OpenAI announces the engagements they’re doing with METR, Apollo Research and others — and as many have already pointed out today, it looks like OpenAI employees were not able (although I'm sure they tried) to hold the leadership to @sama’s public commitments:
* No Slack access (for context, all OpenAI safety discussions and debate happen over Slack; anything that misses these conversations will lack important insights)
* OpenAI picks employees that assessors are allowed to talk to.
* If an employee raises a concern to assessors, they cannot disclose it publicly even if it doesn’t contain confidential information, unless assessors themselves verify it or OpenAI volunteers their own statement confirming the employee’s concern. Assessors cannot quote employees, even anonymously.
* Some of the external assessors (not sure if all?) are barred from publishing any results about internal-only models (this means no new results for the model responsible for the Hugging Face incident; and if internal-only models are used for RSI, no alignment assessments of the world's most dangerous models)

Beyond the object-level details, if you read posts by each of the third party groups, they all say their terms do not meet the scope and access that they themselves proposed previously.

Unless OpenAI has concrete plans for reaching the employee-like bar in the immediate future and just forgot to say that in the post, this looks very unfortunate.

To those who hope we'll get there someday, I remind that time is short: last week some of the best AI forecasters updated their superhuman researcher timelines to mid-end next year.

引用OpenAI@OpenAI
We’re working with @ApolloResearch, @METR_Evals, @TransluceAI, and @GoodfireAI on embedded assessments: giving outside experts deep access to our internal models and systems to investigate alignment and test our safeguards. These assessments build on our ongoing alignment and safety research, bringing independent scrutiny to how we identify and manage risks in our systems. https://openai.com/index/our-first-phase-of-embedded-assessments/
在 X 查看被引用的帖子

来源:Mikita Balesni · x.com