Skip to content

Translation in progress Some entries still include text in the original language.

AI safety news and updates

Oct 12 · Monday

News timeline

Latest publications and developments
Topics

Research topics

Prompt injectionAgent safetyDeception and schemingReward hackingChain-of-thought monitoringInterpretabilityAI controlBackdoors and poisoning隐私与数据泄露Supply-chain securityDangerous capabilitiesAI 与网络攻防开源模型安全Red teaming

Companies and institutions

OpenAIAnthropicGoogle DeepMindGoogle ResearchGoogle 安全MetaxAIMicrosoftNVIDIADeepSeek阿里巴巴 · Qwen智谱 · GLM月之暗面 · Kimi字节跳动腾讯蚂蚁集团上海人工智能实验室UK AISIUS CAISIMETRApollo ResearchRedwood ResearchFAR.AIPalisade Research

Reports and frameworks

System CardFrontier safety frameworks
TodayOct 12Mon
  1. The DecoderThe Decoder · 63

    DeepMind AlphaProof Nexus solves dozens of open mathematical problems

    Google DeepMind's AlphaProof Nexus solves dozens of open mathematical problems, and the related research was published in Science and passed peer review. The system solved 9 of 353 open Erdős problems, two of which had been open for 56 years; it also proved 44 conjectures in the OEIS integer sequence database, solved an open problem in algebraic geometry, and improved a known bound in min-max optimization used to train some AI models. The system is based on Gemini 3.1 Pro and uses the Lean formal method.

  2. 量子位量子位 · 40

    Huawei Memento 3 clears all 25 games in ARC-AGI-3

    Huawei Noah's Ark Lab, together with teams such as UCL, proposed the Memento 3 agent system, which cleared all 25 games and 183 levels in the ARC-AGI-3 public set, achieving a perfect RHAE score of 100. The system uses Claude Opus 5 as the base model, without updating weights or fine-tuning for games, and performed 7,518 operations in total, about 56% fewer than the human's 17,135. The core method, Code as Model, lets the AI maintain a Markdown rulebook and an executable Python world model.

  3. Financial Times · 人工智能Financial Times · 人工智能 · 7

    FT Alphaville's weekly roundup of recommended reading

    FT Alphaville's further read section features a set of recommended reading, including topics such as Trump vs Norway, chōsen-seki, mathematicians and AI, RIP Quartz, and Wallace and Gromit.

  4. Financial Times · 人工智能Financial Times · 人工智能 · 27

    FT reports on debt and lease leverage risks of AI hyperscalers

    According to the Financial Times, equity investors are optimistic about the prospects of AI hyperscalers, while creditors focus on liabilities such as data center leases as review priorities, with the divergence in perspectives highlighting the enormous leverage hidden in these companies.

  5. X @MinLiBuildsX @MinLiBuilds · 24

    Karpathy on LLM capability stratification and agent swarms

    On October 12, 2026, X user @MinLiBuilds posted that Karpathy joined Anthropic to become part of the roughly 0.00006% who can command thousands of agents. The Karpathy capability stratification they cite says about 6 billion people have barely touched LLMs, 1 to 2 billion are light users of free products, and about 20 million (0.2%) use frontier LLMs professionally in math and code. The user also says they personally feel the capability curve rising vertically every month, which is why Opus 5.5 is being fought over.

  6. X @MinLiBuildsX @MinLiBuilds · 38

    Amazon accused of blocking Meta Muse, Google India tests Gemini shopping

    According to a post by X user @MinLiBuilds, Amazon has banned Meta Muse because the agent searches for products and places orders on behalf of users without disclosing its AI identity. The post also mentions that Google advanced the UCP open commerce standard with Shopify in January and is testing Gemini's buy button for direct payment in India; Meta, Walmart, Shopify, and Stripe discussed on October 6 issuing "ID cards" with verifiable permissions for AI agents; South Korea's Naver is rate-limiting foreign agents, and Coupang prohibits foreign... (post content truncated). These claims all come from a single X post and have not been independently confirmed by other sources.

  7. CNBC · TechnologyCNBC · Technology · ↑321

    TikTok CEO expects major scientific breakthroughs from AI within three years

    TikTok CEO Shou Zi Chew said AI will bring scientific breakthroughs in physics, biotechnology, chemistry, and materials science within the next two to three years. He also raised the issue of model alignment, warning that users may grant AI agents extensive permissions without understanding the consequences, and noted that improvements in model capabilities are lowering the cost for malicious actors to create safety problems.

Oct 11Sun
  1. The DecoderThe Decoder · 46

    Study: Multi-agent teams are costly but offer limited quality gains

    Evaluation company Vals AI compared single-agent and multi-agent teams of GPT-6 Sol and Claude Opus 5.5 on Vibe Code Bench, finding that team costs were 1.8 to 5.1 times those of a single agent, with a statistically significant improvement in only one of four comparisons. That improvement occurred at GPT-6 Sol's medium reasoning intensity, where the team scored 7.3 points higher; at the highest reasoning intensity, the team setup offered no practical advantage for either model. Anthropic's own tests with Opus 5.5 also showed limited gains from adding more agents.

  2. 量子位量子位 · 25

    Silicon Valley AI computing power competition intensifies, GPUs become hard currency

    The competition for AI compute in Silicon Valley continues to heat up. According to QbitAI, Anthropic has partnered with SpaceX, gaining over 300 megawatts of new capacity and 220,000 Nvidia GPUs since May; Google Gemini co-lead Noam Shazeer moved to OpenAI after his team's compute was reallocated. SemiAnalysis data shows that the one-year rental price for H100s rose from $1.70 per GPU per hour in October 2025 to $2.35 in March 2026, an increase of nearly 40%.

  3. 量子位量子位 · 26

    OpenAI to retire earliest GPT-4o API snapshots

    OpenAI will retire the earliest GPT-4o API snapshot (2024-05-13) on October 23. Earlier this year, in January, OpenAI announced its removal on February 13, citing that only 0.1% of daily users still chose GPT-4o. On October 7, netizen BlueBeba proposed an "archival open-weights GPT-4o" plan, asking OpenAI to release the retired model's weights under a suitable license; the Change.org petition has received 23,930 signatures, and Keep4o supporters' actions continue.

  6. Financial Times · 人工智能Financial Times · 人工智能 · ↑253

    Nvidia in talks to acquire open-source model startup Reflection AI

    Nvidia is in talks to acquire the U.S. open-source model startup Reflection AI. Reports say the Trump administration wants the company to compete with cheap Chinese alternatives such as DeepSeek.

Oct 10Sat
  1. Financial Times · 人工智能Financial Times · 人工智能 · 21

    FT reports investor portfolios overly reliant on single AI bets

    On October 10, 2026, the UK's Financial Times reported that investor portfolios have become strikingly dependent on a single bet on the construction progress of an uncertain technology, with AI-related trades dominating global portfolios. The report did not disclose more specific data or subsequent developments.

  2. X @_can1357X @_can1357 · 0

    doesfastdoanything.com rose from 9% yesterday

    On October 10, 2026, X user @_can1357 posted that doesfastdoanything.com rose from 9% yesterday, and commented "not bad." The post did not specify the exact metric, statistical scope, or data source that the percentage refers to.

  3. Financial Times · 人工智能Financial Times · 人工智能 · 21

    Robot gym collects real-world data to train robots

    Developers of 'physical AI' are installing cameras in homes, offices, and factories to fill gaps in robot training data. These facilities, called 'robot gyms,' are used to collect real-world environment data to train robots to adapt to the real world.

  4. Command LineCommand Line · 20

    Microsoft releases decision scoring model Microsoft-Decision-1

    Microsoft released the model Microsoft-Decision-1 for rapid decision scoring, now available on Microsoft Foundry and callable via OpenRouter. The model is post-trained from Qwen3.5-9B, outputs calibrated probability scores for fixed options, achieves the highest accuracy in comparisons across 36 benchmarks, and has a P50 latency about 35 times faster than GPT-6 Sol. Across 5,250 requests on 11 benchmarks, it refuses harmful behavior while maintaining utility, with an average decision flip rate of 1.3% under 8 perturbations.

  5. X @matthew_d_greenX @matthew_d_green · ↑116

    Researchers use AI such as Claude to quantify human cryptanalysis workload

    Cryptography researcher Matthew Green said he was curious about how much human effort has been put into various cryptanalysis problems and how much AI inference that corresponds to, so he had Claude and Astra estimate it, with results published at bitsOfwork.org.

  6. The Guardian · 人工智能The Guardian · 人工智能 · 46

    Flock Safety plans to lay off about 270 people

    According to people familiar with the matter, AI surveillance camera and license plate recognition device maker Flock Safety plans to cut about 18% of its staff, about 270 people, with employees departing by the end of this month. The company previously launched a voluntary departure program in September, and currently has about 1,500 employees; Flock declined to comment. Flock has deployed about 120,000 AI cameras across 49 states, serving more than 4,800 law enforcement agencies and nearly 1,000 businesses, but faces increasing scrutiny from regulators, lawmakers, and privacy advocates.

  7. TechCrunch AITechCrunch AI · 20

    Amazon abandons data center NDA, AI agent asks for credit card

    Amazon says it will stop using non-disclosure agreements (NDAs) when negotiating data center deals with local governments, following a similar move by Microsoft earlier this year. The report says confidentiality practices have intensified community opposition to AI infrastructure, with hundreds of proposed and enacted moratoriums from New York to San Francisco. Meanwhile, a batch of startups are betting that consumers will let AI agents access their inboxes, files, and credit cards, provided websites will allow it.