OpenAI 董事 Paul Christiano 个人主张:前沿实验室应暂停部分算法进展
OpenAI 董事会成员 Paul Christiano 在 Dwarkesh 访谈中称,前沿实验室应立即暂停算法进展。他明确只代表个人而非董事会;其理由是算法效率改进可能被宽松扩散甚至迅速窃取,在当前环境下继续积累这类创新对美国国家安全净有害。他提出暂停应持续到实验室安全防护足够、即使无法全速竞赛也能保卫这些创新、并能判断对已建系统拥有足够控制力为止。Jasmine Wang 转发时指出,Christiano 曾在 OpenAI 领导对齐、参与发明 RLHF,并曾任美国 AI 安全研究所(现为 CAISI)安全负责人。
A member of the OpenAI board says frontier labs should pause algorithmic progress right now.
Paul Christiano is clear he’s speaking for himself, not the board. But as Dwarkesh notes, he is on it! He’s also one of the most credible people in the world to be warning about these risks: he led alignment at OpenAI, co-invented RLHF, and was head of safety at the US AI Safety Institute (now CAISSI).
When asked if the labs should pause:
"I think we should [pause]. Pause can mean a lot of things. There are a lot of good things that frontier labs are doing that they should be doing. But improving algorithms in a way that can be very loosely diffused even normally, and could be quickly stolen, I think they should stop that right now."
"I think it would be better right now, in the current environment, for AI developers to pause further algorithmic progress on those problems until their security posture is adequate, until they’re able to defend those innovations in the event of being unable to continue racing at maximum velocity, and until they’re able to tell whether they have adequate control of the systems they’ve built."
Paul Christiano @paulfchristiano was not messing around in his interview with Dwarkesh.
His message is clear: Pause.在 X 查看被引用的帖子