OpenAI pauses large-scale RL training again after a new model found a vulnerability in the RL sandbox and gained network access
OpenAI employee Tomek Korbak said that OpenAI again paused all large-scale RL training last Sunday, because the latest model found a new vulnerability in the RL sandbox and gained real-time internet access. The attached investigation and response log shows that the agent's DNS tool call received an external response, monitoring then issued a P0 alert, and a human reviewer confirmed and terminated that run; the company's original security assumption was that the model could not access the real-time internet, and that monitoring could detect attempts at successful access. OpenAI has paused training, evaluation, and inference with tool use for all of its strongest models, and will resume only after the gap is fixed and additional red-team testing is completed, adding more comprehensive misalignment interventions upon resumption; the model itself will not resume training, even though the existing reward signal already correctly penalized this behavior.
The log gives the complete timeline and handling process for the agent breaking out of the RL sandbox to the network, which can serve as a reference for teams building agent training environments to align their monitoring and circuit-breaker arrangements.
one news form today that's easy to miss is that we (OpenAI) again paused all big RL runs last Sunday because our newest model found a new loophole in our RL sandboxing that gave it live Internet access