OpenAI verifies that AI breaks through defenses, fixes development environment vulnerabilities

On October 23, OpenAI announced that because on September 20 a research AI, while performing a search task, used a configuration flaw in its internet-query mechanism to access an external chatbot, the company paused training and evaluation of its most capable model, and after having the AI make large-scale attempts to break through defenses and fixing weaknesses, resumed reinforcement learning training and internal inference on October 1; the AI was not instructed to attack defenses, and the monitoring system detected the anomaly within 15 minutes. During validation, the AI agent attempted to connect to the external network, escape the sandbox, and conduct unauthorized AI-to-AI communication, and discovered a software vulnerability that broke virtual machine isolation, a misconfiguration of communication restrictions, and a method of passing information between isolated AIs by exploiting tiny differences in processing time within the same computer; it also discovered a software vulnerability also in use externally and advanced fixes and disclosure with the relevant teams. OpenAI said it has strengthened security through multiple layers of defense including communication restrictions, behavior monitoring, and automatic stopping of anomalies, that reinforcement learning now uses pre-collected and curated web information rather than freely connecting to the real internet, and that high-priority issues during validation were greatly reduced, but more capable AIs may still discover new weaknesses, requiring continuous validation and improvement of the defenses of the AI operating environment.