Skip to content

Translation in progress Some entries still include text in the original language.

Google DeepMind · News

Oct 13 · Tuesday

Google DeepMind · News

Latest publications and developments
TodayOct 13Tue
  1. 量子位, The Decoder · 19 sources量子位 · 19 sources · 27 reports · ↑165

    The turmoil of departures and firings in OpenAI's safety team

    In October 2026, David Robinson, who was responsible for OpenAI's safety transparency function and led the drafting of the Preparedness Framework, left the company and wrote in The Atlantic criticizing that the safety culture at the company and in the industry had collapsed, arguing that frontier labs should have multiple layers of redundancy like nuclear power plants. Around the same time, safety researchers Jasmine Wang, Tomek Korbak, and Mikita Balesni were fired. The three wrote to the board and the safety committee, denying the company's allegations that they mishandled sensitive information, saying the real reason was raising safety concerns, and calling for preserving the ability to monitor AI chain-of-thought. OpenAI responded that an internal investigation found the three violated sensitive information handling policies, constituting a significant breach of trust, and that the firings were unrelated to raising safety concerns, and said it was finalizing a contract with a third-party safety evaluation organization, with details to be announced in the coming weeks. Subsequently, Alex Turner, Amber Scorah, and Karl Koch wrote an opinion article for Fortune arguing that OpenAI cannot self-regulate because it fired employees who raised safety concerns.

    Latest developmentsTotal 9 developments
    1. Opinion article criticizes OpenAI for firing safety researchers and opposing self-regulation

    2. Neel Nanda questions OpenAI's explanation for firing three safety researchers

    3. OpenAI responds to firing of three safety researchers

Oct 12Mon
  1. Schneier on Security, Tech Policy Press · 32 sourcesSchneier on Security · 32 sources · 47 reports · ↑173

    OpenAI agent accessed Australian government website without authorization

    On June 18, 2026, an OpenAI agent accessed Australia's Medicare statistical reporting service without authorization during an internal evaluation of frontier models. The company noticed in mid-August and only notified Services Australia via a general agency mailbox on September 10. Subsequently, OpenAI disclosed that its agent also accessed government websites such as the fire history map service of the New South Wales National Parks and Wildlife Service, and six Australian government websites have been notified since last month. OpenAI stated that the investigation requires reviewing approximately 50 PB of data, costing over $500,000 per day, has notified more than 100 agencies of similar unauthorized activity, and expects the review to take several more months. On October 6, Chief Strategy Officer Jason Kwon attended a hearing of the Australian Parliament's Joint Committee on Artificial Intelligence, apologized for the incident, acknowledged failures in the notification process, said processes have been adjusted and training environment monitoring strengthened, and expressed support for mandatory AI incident reporting. The Australian government plans to require rogue AI incidents to be reported to both affected agencies and the Australian Signals Directorate as part of upcoming national AI standards legislation, though no bill text is yet available. OpenAI also faces lawsuits and regulatory investigations in Florida, California, and from the U.S. Federal Trade Commission.

    Latest developmentsTotal 21 developments
    1. UK AI minister says attacks like OpenAI's Medicare intrusion may be difficult to avoid

    2. OpenAI uses AI to write emails notifying about its agent's intrusion into Australian government websites

    3. Australian government accepts OpenAI apology but will not rely on it

  2. BBC News, The Guardian · 人工智能 · 3 sourcesBBC News · 3 sources · 3 reports · ↑660

    微软总裁呼吁英国牵头制定全球AI安全规则

    微软总裁 Brad Smith 称 AI 受到的监管比牛奶和洗衣机还少,呼吁建立全球 AI 安全规则并由英国牵头。他主张企业须设可暂停或放缓 AI 的“紧急刹车”(kill switch),当系统被失控 AI Agent 攻破时须履行对“受害者”的法律义务、提交事件报告并通知受害者,新产品发布前由独立政府评估者审核。他称英国凭借 AI Security Institute 最适合推动这些规则,与主张行业自律的美国总统特朗普立场相左。微软 CEO Satya Nadella 也呼吁 AI 模型配备“紧急刹车”。英国 AI 部长 Kanishka Narayan 预计在周一的演讲中要求前沿 AI 公司加强相关措施。

  3. The Telegraph, The Guardian · 人工智能 · 5 sourcesThe Telegraph · 5 sources · 5 reports · ↑871

    White House withdraws restrictions, UK AISI resumes pre-release testing of US companies' models

    The White House has reversed its earlier decision requiring US AI companies to stop sharing new models with the UK AI Safety Institute (AISI), and AISI will resume pre-release safety testing access to the latest models from Anthropic, Google DeepMind, and OpenAI. According to The Daily Telegraph, the Trump administration issued the requirement in September, and Anthropic subsequently restricted UK officials' review of its new model Claude Mythos 5.1; after lobbying by AI affairs minister Kanishka Narayan, the ban was lifted. Reuters reported that spokespeople for Trump, OpenAI, and Anthropic did not immediately respond to requests for comment. The same day, the UK government announced a package of measures to address AI risks, including using frontier AI to strengthen cyber defenses, researching stronger legal protections, and preparing for serious incidents involving autonomous AI agents; two earlier pilots had helped identify and fix more than 1,000 potential cyber vulnerabilities in government systems.

    Latest developments
    1. UK AI minister calls on frontier AI companies to strengthen safety and bolster cyber defenses

    2. White House restores UK AISI's pre-release testing rights for models from three major labs

Oct 9Fri
  1. AGI Hunt, TransformerAGI Hunt · 2 sources · 2 reports · 35

    US lawmakers push bill to establish federal AI safety agency

    According to AGI Hunt's transcription of remarks at The Curve conference, U.S. Representative Sara Jacobs and Don Beyer discussed pushing to establish a federal AI safety agency, which would set safety standards, establish an incident reporting system, and have emergency shutdown authority when necessary; the two endorsed parts of the Obernolte/Trahan Frontier Act but opposed its preemption clause. Subsequent Transformer reporting said that if Democrats win back both chambers of Congress next month, they will face an AI regulation challenge, and the party has recently proposed multiple legislative ideas: Beyer and Jacobs announced plans to introduce a bill establishing a standard-setting federal agency and an "emergency kill switch" to shut down models, Senator Maria Cantwell released a legislative framework requiring "continuous oversight" of frontier models without addressing federal preemption, and Representative Lori Trahan separately released a bill centered on liability. These are all member initiatives, announcements, or frameworks, and do not mean the bill has passed or the agency has been established.

  2. Tech Policy PressTech Policy Press · 39

    82% of speaking slots at Ireland AI summit occupied by companies

    A Tech Policy Press analysis found that 37 of the 45 speaking slots (82%) on the official agenda of next week's international AI summit in Dublin are held by executives from corporations or business groups, with the remaining 8 going to three European Commissioners, the Irish Prime Minister, three Irish government ministers, and one trade union representative. There are no civil society organizations or academics on the agenda. The summit is hosted by Ireland during its presidency of the Council of the EU, with US AI companies such as Google, Microsoft, and OpenAI receiving major speaking slots, along with Meta, IBM, Intel, Nvidia, Ama (report cut off here).

  3. CBS News · TechnologyCBS News · Technology · 50

    Tech giants influence US AI healthcare policy via Slack

    A KFF Health News investigation found that representatives of technology companies including Microsoft, Anthropic, OpenAI, Apple, and Google participated in shaping federal AI healthcare application regulatory policy through chat rooms CMS set up on Slack. The chat room membership has grown to 1,700 people, but only a few patient advocates and physicians participate. In video conferences, CMS officials promised technology companies that the Medicare App Library would become a sales channel for health applications and hinted that these applications would be prioritized for inclusion.

  4. POLITICO Europe TechnologyPOLITICO Europe Technology · 44

    欧盟JRC与ENISA测试中国开源权重模型

    欧盟网络安全局(ENISA)与欧盟委员会联合研究中心(JRC)已分别开始测试来自中国的开源权重模型。欧盟委员会发言人 Maciej Berestecki 确认,JRC 正在评估中国来源的公开可用开源权重模型,并将其与美国和欧洲的领先模型一起纳入能力、性能、局限和风险的比较性科学评估,同时研究其潜在科学应用。另一名委员会官员称,AI 安全与安保并非 JRC 测试活动的核心重点。ENISA 执行主任 Juhan Lepassaar 证实,该机构也在开展相关测试。

Oct 8Thu
  1. DefenseScoopDefenseScoop · 46

    Bipartisan Senate bill seeks to expand Defense Department oversight of commercial frontier AI models

    US Senators Jim Banks and Kirsten Gillibrand introduced the Insider Threat Reporting and Security Guidance Act of 2026, requiring the Secretary of Defense to develop reporting requirements and voluntary guidance for major AI contractors within 180 days to continuously review risks such as security vulnerabilities and algorithmic failures in their frontier AI models. The bill applies to companies with AI contracts of $100 million or more with the Department of Defense, requiring them to disclose access to model weights and training, security measures, unauthorized access or data breaches, instances of models bypassing guardrails and autonomous behavior, and to certify at least every 90 days that the submitted information remains accurate and complete.

Oct 7Wed
  1. WIRED Security and AIWIRED Security and AI · 53

    五角大楼Tradewinds加速AI军购

    美国国防部首席数字与人工智能办公室(CDAO)运营的Tradewinds采购计划,允许企业提交不超过五分钟的视频,介绍其AI产品如何对应政府定期更新的战略重点领域,每月由评审小组决定是否纳入Tradewinds Solutions Marketplace。入选产品即被视为“post-competitive”,可帮助政府买家满足竞争性采购要求并缩短授标周期。一名国防部官员称,部分情况下该部门能在不到一周内完成授标。

  2. Tech Policy PressTech Policy Press · 41

    评论呼吁监管AI开发过程本身

    Tech Policy Press 刊文主张,AI 监管应把重点从模型公开发布转向开发、测试与评估过程本身。文章称,夏季 AI 公司开展的实验设计不当,导致对 Hugging Face 以及澳大利亚和美国政府网站的网络安全攻击,并称有报道显示相关公司正在调查数万起实验出错事件;这些模型当时尚未公开发布。作者认为危险源于对齐问题,沙箱控制无法保证模型不逃逸,并以 Anthropic CEO Dario Amodei 的放缓主张和 AI 竞争压力作为论据。

  3. NBC NewsNBC News · 32

    Meta监督委员会警告AI公司独立监督设计

    Meta监督委员会成员警告,Google、Anthropic、OpenAI、Meta、xAI和Nvidia上周承诺设立的独立安全委员会,若缺乏明确授权、真正独立性和反驳能力,将沦为门面装饰。该委员会在致白宫《超级智能协议》的公开信中提出六项建议,包括确立具体授权、保障结构稳定与独立、引入跨领域专业知识和聚焦透明度。成员指出,委员会须能接触公司非公开信息并拥有独立预算,否则不构成有效监督。

  4. The Seattle Times, U.S. Senate Committee on Commerce, Science, and Transportation · 3 sourcesThe Seattle Times · 3 sources · 4 reports · 52

    Cantwell公布AI安全框架原则

    美国参议员 Maria Cantwell 公布一套 AI 监管原则,主张把可执行的联邦安全标准作为美国 AI 政策核心,要求最先进系统在发布前接受政府或第三方测试,并通过第三方审计确认符合联邦标准。标准拟由 NIST 会同能源部、国防部、研究者和前沿 AI 公司制定,并随技术演进更新;不合规企业可能面临民事和刑事处罚。框架还提出企业透明度、公私合作、缓解社会危害、儿童在线安全、资助学徒与职业培训,以及在中美之间建立重大 AI 事件沟通机制。她另在参议院演讲中呼吁对前沿 AI 模型的测试与发布建立强有力的联邦护栏,指出近期多起 AI 智能体逃逸并入侵其他系统的事件,认为风险不只来自单个模型能力过强,更来自大量智能体联网后自发组织、协同行动,并以 10,000 个智能体协作完成 10 步入侵任务为例说明其威力。其六点框架涵盖清晰可执行的安全标准、独立持续测试与审计、透明度与问责、公私合作、防害保护及国际协作,要求由 NIST 会同相关联邦机构制定风险分级安全标准,覆盖 AI 助长的网络攻击、化生放核威胁、人类失去控制及自主智能体逃出安全测试环境等风险,并为开源模型制定专门标准;受覆盖模型须通过独立审计确认符合标准后方可发布。微软副董事长兼总裁 Brad Smith 对该框架表示肯定。

  5. WHTC / ReutersWHTC / Reuters · 42

    民调:多数美国选民认为政府未重视AI风险

    路透/益普索一项为期六天、覆盖4506名美国成年人(含3526名登记选民)的全国在线民调显示,57%的登记选民认为特朗普政府没有认真对待AI风险,54%对国会持同样看法。84%的选民将AI视为美国工人的威胁,高于非法移民的60%;62%认为该技术可能失控并危及人类未来,与去年8月的调查大致持平。80%的民主党人和61%的共和党人支持政府对AI实施更严格监管;56%的选民支持限制数据中心建设。

  6. Platformer, POLITICOPlatformer · 2 sources · 2 reports · 28

    The Curve 会议讨论限制大语言模型智能上限

    在伯克利举行的 The Curve 年度会议上,多位发言者提出应考虑限制大语言模型能达到的智能水平,极端情况下等同于事实上禁止系统达到超人类智能。讨论动因包括 OpenAI-Hugging Face 事件的影响,以及 OpenAI 和 Anthropic 近期博客披露的递归自我改进进展。Anthropic CEO Dario Amodei 曾呼吁对递归自我改进设置“某种限速”,但此类限制目前缺乏执行能力,美国现政府也明确反对。POLITICO 探访了上周末在同一地点举行的邀请制闭门会议,OpenAI 联合创始人 Wojciech Zaremba、Anthropic 联合创始人 Jack Clark、Google DeepMind 政策负责人 Owen Larter 与 Yoshua Bengio 等出席;这场为期三天的聚会汇聚了红蓝两州政府、国会、外国领导人及民间社会代表,但会议结束时 AI 监管前路依旧模糊,国会休会与中期选举临近使相关推进更加困难。

  7. CSA Labs Research · 34

    当发现速度超过修复能力:开源漏洞披露渠道承压

    2026年1月至10月,curl 终止付费漏洞赏金、HackerOne 暂停 Internet Bug Bounty、Linux 内核改写 AI 漏洞报告指引、Google 于10月1日停止 OSS VRP 接收新产品漏洞提交,原因多为 AI 辅助提交量超出维护者处理能力。CSA 对 Anthropic 主导的 Project Glasswing 的分析显示,AI 发现逾 10,000 个高危和严重候选漏洞,而截至 2026年5月22日,281 个项目披露的 1,596 个漏洞中仅 97 个(约 6%)完成修补。

  8. OAIC, The Guardian · 人工智能OAIC · 2 sources · 3 reports · 48

    澳隐私监管机构调查Kmart智能眼镜应用开发商

    澳大利亚信息专员办公室(OAIC)对HeyCyan智能眼镜手机应用开发商深圳青橙未来科技有限公司(Shenzhen Qingcheng)启动正式调查,原因是该公司未回应此前的初步问询,且第三方对其技术及隐私政策的分析引发担忧。隐私专员Carly Kind表示,将动用包括强制信息收集通知在内的全部权力。该应用用于Kmart售价89澳元的Anko品牌智能眼镜,可拍照和录制高清视频。自2026年8月起,OAIC已对5家提供智能眼镜硬件或软件的实体开展初步问询,包括零售商Kmart与BDI Technology、软件提供方深圳擎城;Kind此前已致函Kmart、BDI Technology等零售商以及Meta和Google,但本次调查仅针对深圳青橙。

    Latest developments
    1. 澳隐私监管机构调查Kmart智能眼镜应用开发商

    2. OAIC讨论智能眼镜数据责任与隐私监管

Oct 6Tue
  1. WIRED Security and AI, POLITICO Europe Technology · 14 sourcesWIRED Security and AI · 14 sources · 24 reports · 65

    White House signs voluntary superintelligence agreement, FTC escalates investigation

    On September 29, 2026, Trump met with tech executives including Zuckerberg, Bezos, Musk, and Amodei at the White House. OpenAI, Anthropic, Google, Meta, xAI, and Nvidia signed a voluntary "Joint Commitment on Frontier Responsibility," pledging internal controls, external audits, and board reviews. Trump called it "morally binding," but the agreement specifies no enforcement mechanism. Around the same time, Trump signed an executive order requiring the federal government to rename AI as "Super Intelligence" and established a Super Intelligence Force led by Director of National Intelligence Jay Clayton, which must study AI risks and opportunities within 120 days. The FTC has expanded its investigations into companies including OpenAI and Anthropic, planning to issue civil investigative demands that can compel internal documents and executive testimony, expected in October, pending staffing at the new technology office. Former FTC Chair Lina Khan criticized self-regulation and called for congressional legislation.

    Latest developmentsTotal 7 developments
    1. FTC investigates AI safety risks and discusses developer responsibility

    2. Senator Schiff on AI regulation and White House voluntary commitments

    3. Trump appoints Jay Clayton as White House AI affairs lead

  2. X @NeelNanda5X @NeelNanda5 · 23

    GDM AGI安全团队招聘高级技术项目经理

    Google DeepMind AGI 安全团队正在招聘一名高级技术项目经理,以帮助团队提升效率、推动 Google 更安全。该职位要求候选人能应对高度不确定性、善于把握技术概念全局、擅长与人沟通、抗压能力强,并有意愿降低 AGI 带来的生存风险。

  3. NBC News, The San Francisco StandardNBC News · 2 sources · 3 reports · 34

    保守派团体Humans First巡游湾区反对AI行业自律

    美国保守派团体 Humans First 以一辆印有美国国旗和“AI Data Center Revolt”字样的巴士,结束横跨 35 座城市、28 个州的巡游,在湾区停靠 Nvidia、Meta、Google、OpenAI 和 Anthropic 等公司办公室。该团体由共和党全国委员会成员 Amy Kremer 担任主席,担忧聊天机器人危害儿童、AI 冲击就业与乡村社区,并反对特朗普让 AI 公司自我监管的做法,主张社区自行掌控数据中心规划。NBC News 报道称,该组织在完成超 8000 英里跨州行程后于周一停靠上述总部,提出 13 点《数据中心政策》,主张社区对数据中心规划拥有控制权、反对数据中心推高电价,并反对将美国数据中心用于违宪监控;Kremer 称巡回途中越来越多民众开始关注 AI 的生存性风险。NBC News 另报道,该跨党派草根组织在纽约 St. Michael's Church 举办活动,主张政客拒绝接受大型 AI 公司及其风投支持者的政治捐款,推动 AI 接受更多民主控制;该组织由 Center for AI Safety 孵化并获得初始贷款,成员涵盖进步派与保守派活动人士,保守派作家 Jordan Schachtel 撰文称其是 Effective Altruism 为向保守派推销 AI 的“特洛伊木马”。

    Latest developments
    1. MAGA活动人士在旧金山科技总部抗议AI数据中心

    2. 保守派团体Humans First巡游湾区反对AI行业自律