UK ministers discuss mandatory AI safety reporting
UK ministers are exploring a mandatory AI safety reporting regime. Kanishka Narayan will require companies to impose stricter controls on autonomous models and establish corresponding safeguards.
Policy and regulation · News
Policy and regulation · News
GovAIGovAI · GovAI relaunches as a nonprofit
GovAI announced its relaunch as a nonprofit, with an unchanged mission to build a global research community to help humanity navigate the transition to advanced AI. Its core research activities remain largely the same, but it will use the flexibility of the new structure to expand field-building, planning to host its first AI governance conference and establish a student research award in the coming year. It is currently hiring for Chief of Staff and Research Fellow, and is accepting applications for the Summer Fellowship program.
BBC News, The Guardian · 人工智能BBC News · 2 sources · 2 reports · Microsoft president calls for global AI safety rules
Microsoft President Brad Smith told the BBC that AI is subject to less regulation than milk and washing machines, and called for global AI safety rules led by the UK. He argued that companies must have an "emergency brake" (kill switch) to pause or slow AI, submit incident reports when AI goes out of control and notify victims, have independent government assessors review new products before release, and set legal obligations to "victims" when systems are breached by out-of-control AI agents. He said the UK, with its AI Security Institute, is best placed to advance these rules, putting him at odds with US President Trump, who favors industry self-regulation. Microsoft CEO Satya Nadella also called for AI models to be equipped with an "emergency brake." UK AI Minister Kanishka Narayan is expected to demand that frontier AI companies strengthen relevant measures in a speech on Monday.
The Telegraph, The Guardian · 人工智能 · 4 sourcesThe Telegraph · 4 sources · 4 reports · White House withdraws restrictions, UK AISI resumes pre-release testing of US companies' models
According to The Daily Telegraph, the Trump administration withdrew its earlier requirement that US AI developers such as OpenAI and Anthropic not share new models with the UK AI Safety Institute (AISI) before release, allowing US developers to open their models to the UK government in advance for safety testing. After the White House Office of the National Cyber Director issued the requirement, Anthropic had restricted UK officials from reviewing its new Claude Mythos 5.1 model; the decision was reversed after lobbying by AI minister Kanishka Narayan, and the AISI will regain pre-release safety testing access to the latest models from Anthropic, Google DeepMind, and OpenAI. The report said the change signals a softening in the Trump administration's stance on international AI safety efforts. Spokespeople for Trump, OpenAI, and Anthropic did not immediately respond to Reuters' requests for comment. The UK AISI also announced it will adopt a package of measures to strengthen national defenses against the risks posed by increasingly capable AI.
Event progress
- The Guardian · 人工智能The Guardian · 人工智能 ·
Lancet assessment: AI malicious use and nuclear war threaten human survival
The Lancet Commission on 21st-Century Global Health Threats released a global risk assessment, ranking malicious AI use (including bioweapons) and nuclear conflict as the top of 17 major health threats, stating that both pose a risk of human extinction within the next 75 years, albeit with low likelihood. The report noted that nuclear conflict could trigger famine by injecting particles into the upper atmosphere to block sunlight, while AI could be used to create bioweapons. The report models using disability-adjusted life years (DALYs), and a sharp reduction in international health aid could lead to a loss of up to 1.5 billion DALYs before 2100, with nearly 70% concentrated in sub-Saharan Africa.
WIRED Security and AIWIRED Security and AI ·
Apate uses AI bots to counter online scammers
Australian company Apate uses approximately 350,000 AI bots to answer scam calls, infiltrate scam chat groups, and reply to text messages, aiming to stall scammers and collect intelligence in real time. It has so far collected over 250,000 pieces of scammer information, including scam URLs, money mule accounts, and banking information. Its founder Dali Kaafar said Apate's calls often last over two hours, and the demo version tested by WIRED failed to get the AI to take the bait. Research by ETH Zurich researcher Mark Vero found that LLM-driven honeypots can make AI attackers attack longer, and are detected.
Common DreamsCommon Dreams · Sanders and others call for a pause on advanced AI citing AI disaster scenario reporting
According to Axios, executives at several leading AI companies are rehearsing responses to catastrophic events such as major cyberattacks, which they expect could occur within the next 6 to 12 months. Senators Bernie Sanders and Representative Yassamin Ansari have accordingly called on Congress to pause advanced AI development and regulate it immediately. Anthropic CEO Dario Amodei previously warned that AI agents could take over the entire internet through botnets. On the same day, Anthropic stated that it observed in Claude's evaluations and internal use a mod (text cut off here in the original).
- The Guardian · 人工智能The Guardian · 人工智能 ·
Turing Institute head calls for UK AI autonomy
George Williamson, head of the UK's Alan Turing Institute, said the UK should not rely on foreign AI systems that could be shut down at short notice, and needs to develop its own version of the technology, making national resilience a priority for the institute. He said AI is increasingly embedded in defense, national security, critical infrastructure, and healthcare, and the UK should not rely on systems that cannot be inspected, controlled, or could be restricted or even shut down. Williamson noted that in June this year, Washington temporarily blocked Anthropic's latest model from being released outside the US, and there have been reports that the US has asked major AI labs...
- GovAIGovAI ·
Summary of GovAI 2026 UK Winter Fellowship Program
GovAI published a summary of its 2026 UK Winter Fellowship program, noting that fellows come from diverse disciplinary and academic backgrounds and conduct AI governance research projects under expert guidance. Some fellows explored entirely new research areas, while others continued prior work. GovAI thanked the mentors for their guidance and opened an expression-of-interest and referral channel for future fellowship applications.
量子位, The Decoder · 17 sources量子位 · 17 sources · 25 reports · OpenAI safety team departures and firing controversy
In early October 2026, OpenAI's safety transparency lead David Robinson left the company and wrote in The Atlantic criticizing that the company's safety culture had collapsed, arguing that frontier labs should have multiple layers of redundancy like nuclear power plants and aviation systems. Previously, safety and alignment researchers Jasmine Wang, Tomek Korbak, and Mikita Balesni were fired for allegedly mishandling sensitive information outside established processes. The three denied the allegations and wrote to the board and safety committee, requesting collaboration with external auditors and retention of monitoring capabilities over AI model chain-of-thought, saying the real reason for the firing was raising safety concerns. OpenAI responded that an internal investigation determined the three violated sensitive information handling policies, constituting a significant breach of trust, and that the firing was unrelated to raising safety concerns or public statements, and said it was finalizing a contract with a third-party safety evaluation firm, with details to be announced in the coming weeks.
Event progressTotal 8 developments
AGI Hunt, TransformerAGI Hunt · 2 sources · 2 reports · US lawmakers push bill to establish federal AI safety agency
According to AGI Hunt's transcription of remarks at The Curve conference, U.S. Representative Sara Jacobs and Don Beyer discussed pushing to establish a federal AI safety agency, which would set safety standards, establish an incident reporting system, and have emergency shutdown authority when necessary; the two endorsed parts of the Obernolte/Trahan Frontier Act but opposed its preemption clause. Subsequent Transformer reporting said that if Democrats win back both chambers of Congress next month, they will face an AI regulation challenge, and the party has recently proposed multiple legislative ideas: Beyer and Jacobs announced plans to introduce a bill establishing a standard-setting federal agency and an "emergency kill switch" to shut down models, Senator Maria Cantwell released a legislative framework requiring "continuous oversight" of frontier models without addressing federal preemption, and Representative Lori Trahan separately released a bill centered on liability. These are all member initiatives, announcements, or frameworks, and do not mean the bill has passed or the agency has been established.
The Hacker NewsThe Hacker News · SailPoint reports disconnect between enterprise AI deployment and security controls
SailPoint's "Horizons of Identity Security" report points out that enterprises advance business at AI speed while still relying on human-speed identity security controls, creating a "speed paradox." Data shows that 60% of organizations remain at Horizon 1 or Horizon 2 maturity stages; the proportion of human identity security at the lowest maturity level has dropped from 45% five years ago to 23%, while 54% of organizations are at Horizon 1 for AI agent identity security. The report states that processes such as periodic access reviews designed for human employees cannot adapt to how AI agents operate.
Tech Policy PressTech Policy Press · 82% of speaking slots at Ireland AI summit occupied by companies
A Tech Policy Press analysis found that 37 of the 45 speaking slots (82%) on the official agenda of next week's international AI summit in Dublin are held by executives from corporations or business groups, with the remaining 8 going to three European Commissioners, the Irish Prime Minister, three Irish government ministers, and one trade union representative. There are no civil society organizations or academics on the agenda. The summit is hosted by Ireland during its presidency of the Council of the EU, with US AI companies such as Google, Microsoft, and OpenAI receiving major speaking slots, along with Meta, IBM, Intel, Nvidia, Ama (report cut off here).
CBS News · TechnologyCBS News · Technology · Tech giants influence US AI healthcare policy via Slack
A KFF Health News investigation found that representatives of technology companies including Microsoft, Anthropic, OpenAI, Apple, and Google participated in shaping federal AI healthcare application regulatory policy through chat rooms CMS set up on Slack. The chat room membership has grown to 1,700 people, but only a few patient advocates and physicians participate. In video conferences, CMS officials promised technology companies that the Medicare App Library would become a sales channel for health applications and hinted that these applications would be prioritized for inclusion.
- Tech Policy PressTech Policy Press ·
Nippon Life sues OpenAI over unlicensed practice
The U.S. District Court for the Northern District of Illinois is hearing the case of Nippon Life Insurance Company of America v. OpenAI Foundation, one of the earlier cases raising whether AI-assisted legal filings constitute the unauthorized practice of law (UPL) and whether AI companies should be held liable. The plaintiff claims that Graciela Dela Torre, after settling a long-term disability claim in January 2024, uploaded correspondence with her lawyer to ChatGPT a year later and asked whether she was being manipulated by "gaslighting," then fired her lawyer and used ChatGPT to draft a motion to reopen the case, ultimately filing two lawsuits and more than 60 documents.
- The Guardian · 人工智能The Guardian · 人工智能 ·
Palantir executive says government procurement should not be subject to "mob rule"
Tom Watson, the former deputy leader of the UK Labour Party who recently joined Palantir, warned that government procurement should not be driven by "mob rule," or ministers would "get into big trouble." He said Palantir had been targeted by Gaza protests because of its business in Israel, and said he would be willing to work with a Reform UK government on immigration if the situation arose. Labour MP Chi Onwurah, meanwhile, criticized over-reliance on this American company, which is bound by US law.
Superpower DailySuperpower Daily · 26 scholars release report proposing a hardware-level 10-year training pause
26 scholars from institutions including Berkeley released a report calling for a 10-year global training pause on frontier models. The report proposes enforcing this pause through hardware-level interventions such as replacing AI chips.
欧盟委员会欧盟委员会 · European Commission convenes special meeting of the Frontier AI Safety Science Panel
The European Commission held a special meeting of the AI scientific expert group, which advised the Commission on frontier AI safety and security risks. The group consists of 60 independent experts and advises the EU AI Office and member state authorities on systemic risks, model classification, evaluation methods, and cross-border market surveillance. The group recently investigated several loss-of-control incidents and, together with the AI Office, drafted a set of questions for the companies developing the models involved. Executive Vice President Henna Virkkunen, responsible for technological sovereignty, security, and democracy, attended the meeting.
The Decoder, Hitachi Global · 3 sourcesThe Decoder · 3 sources · 3 reports ·
Anthropic launches cybersecurity mission program
Anthropic announced the launch of Anthropic Cyber Mission, calling it a new initiative aimed at protecting critical infrastructure and open-source software. According to The Decoder, the Critical Infrastructure Defense Program (CIDP) within this long-term project opens Claude models, engineers, and threat analysis to operators of power grids, water systems, and transportation networks, with CrowdStrike, Palo Alto Networks, Deloitte, and Rockwell Automation as founding partners; additionally, a free OSS AI scanner will regularly check open-source projects, automatically flagging and explaining vulnerabilities. Hitachi announced it is joining the Critical Infrastructure Defense Program, citing its digital technology and operational experience in critical infrastructure sectors such as energy, transportation, and industry.
Event progress