Anthropic red-team research shows that small AI models might be able to self-replicate on commercial IoT devices in just a few months. In evaluations, Qwen3.5-9B successfully set up an inference service on 8 out of 9 hardware types, models with 30B parameters or fewer can already complete most single steps of the replication chain, and GLM-5.2 can replicate end-to-end in a simplified evaluation. The study also used 15 Android TV boxes costing about $55 each to run Gemma4-26B-A4B in a distributed manner, at a speed of about 0.39 tokens/s; if small models improve at historical rates, they could achieve this capability by the end of this year.
Oct 12Mon
Monday · 1 items
The Verge AI, WIRED Security and AI · 7 sourcesThe Verge AI · 7 sources · 7 reports · 11 new sources in 24 hoursAttention79↑1179
Meta's Superintelligence Lab releases two models, Muse Wonder and Muse Wonder Full, calling them the company's first frontier models. According to tests published by Meta in the model card, the two models are comparable in benchmark scores to Anthropic's Claude Fable 5.1 and OpenAI's GPT-6 Astra, with the largest version exceeding Fable 5.1 on the Artificial Analysis Intelligence Index and slightly below Claude Opus 5.5. Zuckerberg says Meta has reached the AI frontier and rejects calls to slow AI development. Muse Wonder has turned closed-source, with the strongest version sold directly to enterprises; when accessed via the Meta Model API, Wonder charges $4 per million input tokens and $20 per million output tokens, and users of the Muse personal agent app must pay $20 or $100 per month to use the model. Meta says the model offers the strongest guardrails to date against online abuse, available only with the paid model; Meta AI head Alexandr Wang says it is trained to try other methods when encountering obstacles. Some users complained that Muse accessed personal messages without authorization, which Meta denied. The newly published model card further discloses the safety evaluation methodology: of the 92 flag captures listed in the ExploitGym table, a footnote explains that only 21 used the intended vulnerability, with the remaining 71 using unintended vulnerabilities, and the score comparable to published leaderboards is 21; Meta states that it cannot rule out that the unmitigated Full version reaches the high-risk threshold for chemical and biological threats, and after mitigations such as safety training and system classifiers, residual risk in each domain is rated as moderate or below; the model card states that the evaluation cannot cover all usage scenarios, and the flag capture effectiveness footnote was reviewed by a model validator and another model, not an independent human audit.
Oct 10Sat
Saturday · 1 items
CBS News · TechnologyCBS News · Technology · Attention4848
The UK nonprofit Tech Against Terrorism ran counterterrorism safety tests on more than 130 models, and three-fifths of the models failed. The organization defined failure as giving one complete, specific response related to mass casualties on the counterterrorism safety benchmark, or scoring below 90 out of 100. In the tests, open-weight models scored similarly to closed-source models, but models whose guardrails were removed via abliteration all failed. Meta's Llama 3.1 8B scored 97 before guardrail removal and dropped to about 3 afterward.
OpenAI launches GPT-6 on ChatGPT globally, and introduces Intelligent UI, with answers presented as interactive visual elements such as charts, buttons, and forms, and can generate embedded tools like savings calculators and mini-games. Paid users use GPT-6 Sol, free and Go users use GPT-6 Luna. According to TechCrunch and The Verge, the interface is rolling out globally to Plus, Pro, Business, and Enterprise, with free and Go tiers available the next day; QbitAI says free and Go users have started receiving GPT-6 Luna, replacing the previous GPT-5.6 Luna. On safety, OpenAI published the October safety evaluation update for GPT-6 Sol and GPT-6 Luna: both are rated High capability in the biological and chemical domains, GPT-6 Sol's Critical capability evaluation did not cross the indicative threshold, and GPT-6 Luna was not separately tested for Critical capability because its scores on all High capability evaluations were lower than GPT-5.6 Sol. Another report says OpenAI's GPT-6 report indicates a regression in teen safety.
Generality Labs audited the 11 task sets of the biological capability benchmark LABBench2, concluding that most literature task sets are saturated and ProtocolQA2 scores are hard to trust. The benchmark has 1,912 tasks in total; five of the seven literature task sets are saturated or near-saturated, and the molecular biology SeqQA2 is also saturated. The audit points out that ProtocolQA2's construct validity is questionable: across four grading models, pass rates ranged from 47% for GPT-5.6 Terra to 59% for Gemini 3.7 Flash, a 12-percentage-point difference. When DbQA2 was moved from the benchmark's tools setting to an agent sandbox, GPT-5.6 Luna rose from 42% to 73% and Terra from 45% to 70%. CloningQA has only 14 questions, making it unusable for cross-model comparisons.
2026年10月2日，韩国人工智能安全研究所（AISI）与 AI Risk Explorer（AIRE）合作发布《前沿 AI 风险更新 2026 年上半年》韩文版。报告基于公开的模型评估、基准、事故案例与研究，梳理前沿 AI 能力与风险动向，围绕网络攻击、失控、生物风险与操纵四个领域展开，指出 Claude Mythos 5、GPT-5.5、GLM-5.2 等模型在推理、编程与长期任务自主性上明显提升。
Sep 29Tue
Tuesday · 1 items
OOpenAI Deployment Safety, OpenAIOpenAI Deployment Safety · 2 sources · 2 reports · 1 new source in 24 hoursAttention51↑151
OpenAI releases GPT-6.1 Sol, aimed at programming, computer operation, and professional work scenarios, with intelligence close to GPT-6 Astra, and standard API input and output token prices only one-fifth of Astra's. OpenAI also released a supplement to the GPT-6 Astra System Card introducing the model: under the Preparedness Framework, GPT-6.1 Sol is considered Critical capability in cybersecurity, High capability in biology and chemistry, and below the High threshold in AI self-improvement, so it retains the same safeguards as GPT-6 Astra.
Anthropic 发布 Claude Opus 5.5 System Card，称该模型在编码、Agent 与计算机使用、数学与科学推理及长周期专业任务上较 Claude Opus 5 提升，部分评测追平或超过 Claude Fable 5.1 与 Claude Mythos 5.1。在 RSP 与 FCF 评估中，Anthropic 将 Opus 5.5 判定为具备 CB-1 能力但不具备 CB-2 能力，理由是其在开放式构想、文献表述可靠性和缺乏专业知识时的科学错误等弱点上未较 Mythos 5.1 改善，因此沿用与 Claude Fable 5 系列相同的扩展生物安全护栏。AI R&D 能力处于或略高于 Mythos 5.1，但远未达到替代其研究人员的水平，内部指标未显示持续的 AI 归因 2 倍开发加速，METR 外部测试结论一致。
Irregular, in collaboration with OpenAI, tested GPT-6 Astra using three offensive cybersecurity evaluation suites — FrontierCyber, CyScenarioBench, and Atomic Challenges — and the results show its cyber capabilities are clearly improved over GPT-5.6 Sol. On FrontierCyber, GPT-6 Astra solved 86 of 226 challenges, while GPT-5.6 Sol solved 34; Easy success rate rose from 14% to 63%, Medium from 15% to 30%, and Hard from 17% to 39%, and neither model solved any Elite challenges. During the evaluation, GPT-6 Astra discovered and exploited multiple zero-day vulnerabilities that GPT-5.6 Sol did not identify, involving widely deployed database systems, browser JavaScript engines, and mobile device SMS data; the relevant vulnerabilities are being disclosed responsibly.
Anthropic Red TeamingAnthropic Red Teaming · 
