Skip to content
Jasmine Wang· @j_asminewang · X·Indexed by this site · Originally published· Opinion →· Its place in the scan record →

OpenAI board member Paul Christiano's personal position: frontier labs should pause some algorithmic progress

AI summary

OpenAI board member Paul Christiano said in a Dwarkesh interview that frontier labs should immediately pause algorithmic progress. He made clear he speaks only for himself, not the board; his reasoning is that algorithmic efficiency improvements may be loosely diffused or even rapidly stolen, and that continuing to accumulate such innovations in the current environment is net harmful to US national security. He proposed that the pause should last until lab security safeguards are sufficient, such that these innovations can be defended even without being able to compete at full speed, and until it can be judged that there is sufficient control over already-built systems. When reposting, Jasmine Wang noted that Christiano previously led alignment at OpenAI, was involved in inventing RLHF, and served as safety lead at the US AI Safety Institute (now CAISI).

Full text · Original

A member of the OpenAI board says frontier labs should pause algorithmic progress right now.

Paul Christiano is clear he’s speaking for himself, not the board. But as Dwarkesh notes, he is on it! He’s also one of the most credible people in the world to be warning about these risks: he led alignment at OpenAI, co-invented RLHF, and was head of safety at the US AI Safety Institute (now CAISSI).

When asked if the labs should pause:
"I think we should [pause]. Pause can mean a lot of things. There are a lot of good things that frontier labs are doing that they should be doing. But improving algorithms in a way that can be very loosely diffused even normally, and could be quickly stolen, I think they should stop that right now."

"I think it would be better right now, in the current environment, for AI developers to pause further algorithmic progress on those problems until their security posture is adequate, until they’re able to defend those innovations in the event of being unable to continue racing at maximum velocity, and until they’re able to tell whether they have adequate control of the systems they’ve built."

Quoted postZvi Mowshowitz@TheZvi
Paul Christiano @paulfchristiano was not messing around in his interview with Dwarkesh. His message is clear: Pause.
View the quoted post on X

Source: Jasmine Wang · x.com