UK strengthens national defenses against growing AI risks

The UK government announced a package of measures to address increasingly powerful AI risks, including using frontier AI to harden cyber defenses, researching stricter legal protections, and preparing for serious incidents involving autonomous AI agents. Two earlier pilots had already helped identify and fix more than 1,000 potential cyber vulnerabilities in government systems. The government will consider institutionalizing through the Cyber Security and Resilience Bill the way serious AI incidents and near-misses are identified and reported, and will study the risk of autonomous AI systems escaping human oversight. The National Cyber Security Centre (NCSC) and the AI Security Institute are working together to research how to respond to AI agent incidents. The AI Security Institute is conducting rigorous evaluations of the latest generation of advanced models.