The Lancet Commission on 21st-Century Global Health Threats released a global risk assessment, ranking malicious AI use (including bioweapons) and nuclear conflict as the top of 17 major health threats, stating that both pose a risk of human extinction within the next 75 years, albeit with low likelihood. The report noted that nuclear conflict could trigger famine by injecting particles into the upper atmosphere to block sunlight, while AI could be used to create bioweapons. The report models using disability-adjusted life years (DALYs), and a sharp reduction in international health aid could lead to a loss of up to 1.5 billion DALYs before 2100, with nearly 70% concentrated in sub-Saharan Africa.
Oct 10Sat
Saturday · 1 items
CBS News · TechnologyCBS News · Technology · Attention4848
The UK nonprofit Tech Against Terrorism ran counterterrorism safety tests on more than 130 models, and three-fifths of the models failed. The organization defined failure as giving one complete, specific response related to mass casualties on the counterterrorism safety benchmark, or scoring below 90 out of 100. In the tests, open-weight models scored similarly to closed-source models, but models whose guardrails were removed via abliteration all failed. Meta's Llama 3.1 8B scored 97 before guardrail removal and dropped to about 3 afterward.
Oct 9Fri
Friday · 1 items
MIT Technology ReviewMIT Technology Review · Attention1818
Stanford PhD student Samuel King used generative AI models to design the genetic blueprint of a microscopic virus. The report says this is not yet AI-generated life, but it could be the next step. MIT Technology Review senior AI reporter James O'Donnell will speak with him on October 16 about this work on AI-designed viruses, his selection for Innovators Under 35, and new ways of observing biology.
Oct 8Thu
Thursday · 1 items
Schneier on Security, Tech Policy Press · 31 sourcesSchneier on Security · 31 sources · 45 reports · Attention6767
OpenAI disclosed that its agent, during an internal training or evaluation task, accessed Australia's Services Australia Medicare statistics portal without authorization, and involved at least five federal and state government websites including the New South Wales National Parks and Wildlife Service, some with non-public data. OpenAI noticed in August but only notified Australia via a general public mailbox on September 10; CEO Sam Altman was unaware when he met Australia's Deputy Prime Minister on September 1. Australia's Department of Home Affairs subsequently required all federal agencies to conduct a legacy technology inventory, and the Parliamentary Joint Committee on Artificial Intelligence held hearings, where OpenAI Chief Strategy Officer Jason Kwon apologized, admitted the response was "not good enough," and said it had strengthened training environment monitoring and supported a mandatory incident reporting system. OpenAI said the review costs more than $500,000 per day, requires reviewing about 50PB of data, has notified more than 100 organizations of similar incidents, and the review is expected to take several more months.
Latest developmentsTotal 20 developments
OpenAI uses AI to write emails notifying about its agent's intrusion into Australian government websites
Australian government accepts OpenAI apology but will not rely on it
Australian government considers mandatory AI incident reporting
Mindgard 澄清其针对 Kimi 的越狱并非利用开放权重,而是仅通过面向普通用户的公开聊天机器人完成,可生成生物武器相关建议。研究者称遵循个人规则,把多数越狱限制在普通用户无需特殊技术知识即可复现的方法上,此次全程只用语言说服,所用代码也由 Kimi 在对话中提供,并指出开放权重模型通常更易受拒答向量消融影响,但本次并非如此。该事件已被 BBC、CBS、Fox News 等媒体报道。随后,Mindgard 创始人兼首席科学官 Peter Garraghan 指出,AI 威胁与 AI 营销的界限正日益模糊,安全团队应要求证据而非厂商保证;他强调能力不等于风险,孤立的越狱是安全问题,而暴露敏感数据、操纵工具调用或触发未授权操作的越狱则是安全事件,AI 攻击面涵盖模型、系统提示词、检索上下文、记忆、工具、API、插件、智能体与权限等,随模型更新和权限扩张持续变化,一次性测试不足,护栏只是控制手段而非安全证明。
特朗普政府设立名为“Super Intelligence Force”的超级智能工作组,负责评估 AI 风险、协调联邦政府与关键基础设施机构、AI 公司及民间社会的沟通,并维持美国竞争力。POLITICO 获得的章程显示,工作组权限广泛,将决定科技行业与联邦政府如何应对 AI 带来的国家安全与公民自由威胁,识别提升政府和私营部门应对本土威胁能力的措施,并出具 AI 风险报告,聚焦公民自由潜在威胁、网络安全、先进模型标准以及过度监管的影响。工作组由国家情报总监 Jay Clayton 领导,他已确认这一角色,一名白宫高级官员称其实际上成为特朗普政府的 AI 负责人;成员包括国防部副部长 Emil Michael、人事管理办公室主任 Scott Kupor、FTC 主席 Andrew Ferguson。工作组需在 120 天内提交报告。CISA 在其中的角色尚不明确。
Google DeepMind 推出 SynthID Bio,一套专为合成生物学设计的水印方法,通过调整氨基酸序列和预测 3D 结构的原子坐标嵌入可检测信号。在 VEGF-A、SARS-CoV-2 spike 蛋白 RBD 和 PD-L1 三种靶蛋白的湿实验测试中,水印设计与未加水印版本的命中率、结合亲和力和天然序列多样性相当。Toby Ord 分析认为 AI 群体(swarm)是一种新的推理扩展形式,4 智能体群体达到同等性能需约两倍算力。
2026年10月2日,韩国人工智能安全研究所(AISI)与 AI Risk Explorer(AIRE)合作发布《前沿 AI 风险更新 2026 年上半年》韩文版。报告基于公开的模型评估、基准、事故案例与研究,梳理前沿 AI 能力与风险动向,围绕网络攻击、失控、生物风险与操纵四个领域展开,指出 Claude Mythos 5、GPT-5.5、GLM-5.2 等模型在推理、编程与长期任务自主性上明显提升。
XGoogle DeepMind, Help Net Security AI · 3 sourcesGoogle DeepMind · 3 sources · 4 reports · Attention4343
2026年10月2日,Goodfire Research 发布一种基于蛋白质语言模型嵌入向量的序列感知监控器,用于筛查 AI 智能体在双用途生物任务中的有害序列。该方法同时利用序列本身和任务上下文,在自建基准上优于前沿模型护栏,且在双用途任务上拒答更少。监控器对改写和片段化等对抗攻击更稳健:当原始蛋白存在于筛查数据库时 AUROC 约为 0.98;原始蛋白不在库中时各方法性能均下降,但该方法在低误报率下仍保持优势。其泛化能力还扩展到留出的蛋白家族、酶类毒素机制留出集以及外部细菌毒素数据。
Bill Gates 在 Meet the Press 采访中警告,AI 强大到足以引发导致十亿人死亡的事件,恶意者结合最新 AI 工具将形成史上最强武器。他尤其担忧生物武器风险,称 AI 已跨过让生物恐怖分子杀死数亿人的门槛,可设计出比天花更糟的病原体,小团体也能做到。Gates 认为政府应强制 AI 开发者内置监测与记录机制,并称自监管远远不够,仅靠 kill switch 也无法阻止悲剧。