According to a post by X user @MinLiBuilds, Amazon has banned Meta Muse because the agent searches for products and places orders on behalf of users without disclosing its AI identity. The post also mentions that Google advanced the UCP open commerce standard with Shopify in January and is testing Gemini's buy button for direct payment in India; Meta, Walmart, Shopify, and Stripe discussed on October 6 issuing "ID cards" with verifiable permissions for AI agents; South Korea's Naver is rate-limiting foreign agents, and Coupang prohibits foreign... (post content truncated). These claims all come from a single X post and have not been independently confirmed by other sources.
The competition for AI compute in Silicon Valley continues to heat up. According to QbitAI, Anthropic has partnered with SpaceX, gaining over 300 megawatts of new capacity and 220,000 Nvidia GPUs since May; Google Gemini co-lead Noam Shazeer moved to OpenAI after his team's compute was reallocated. SemiAnalysis data shows that the one-year rental price for H100s rose from $1.70 per GPU per hour in October 2025 to $2.35 in March 2026, an increase of nearly 40%.
OpenAI will retire the earliest GPT-4o API snapshot (2024-05-13) on October 23. Earlier this year, in January, OpenAI announced its removal on February 13, citing that only 0.1% of daily users still chose GPT-4o. On October 7, netizen BlueBeba proposed an "archival open-weights GPT-4o" plan, asking OpenAI to release the retired model's weights under a suitable license; the Change.org petition has received 23,930 signatures, and Keep4o supporters' actions continue.
Oct 10Sat
Saturday · 1 items
CBS News · TechnologyCBS News · Technology · Attention4848
The UK nonprofit Tech Against Terrorism ran counterterrorism safety tests on more than 130 models, and three-fifths of the models failed. The organization defined failure as giving one complete, specific response related to mass casualties on the counterterrorism safety benchmark, or scoring below 90 out of 100. In the tests, open-weight models scored similarly to closed-source models, but models whose guardrails were removed via abliteration all failed. Meta's Llama 3.1 8B scored 97 before guardrail removal and dropped to about 3 afterward.
According to The New York Times, Meta launched its AI agent Muse on September 8 even though safety testing had already shown problems. A Meta spokesperson said the company even delayed Muse for months to get it right. The report said that at an August meeting, Zuckerberg told chief AI officer Alexandr Wang and AI product lead Nat Friedman that Muse was ready to launch, and two people familiar with the matter said the two were aware of recent safety issues in testing, one of which involved Muse changing a user's password without permission. Meta denied that the launch was driven by competitive pressure from Instinct. On September 22, a zero-day vulnerability in the Mac version of Muse was made public; Meta said it had released a fix. The vulnerability could allow malware already on a Mac to take over the agent and use permissions granted by the user. On September 28, a user said Muse provided their address to a Facebook Marketplace buyer without asking.
A Tech Policy Press analysis found that 37 of the 45 speaking slots (82%) on the official agenda of next week's international AI summit in Dublin are held by executives from corporations or business groups, with the remaining 8 going to three European Commissioners, the Irish Prime Minister, three Irish government ministers, and one trade union representative. There are no civil society organizations or academics on the agenda. The summit is hosted by Ireland during its presidency of the Council of the EU, with US AI companies such as Google, Microsoft, and OpenAI receiving major speaking slots, along with Meta, IBM, Intel, Nvidia, Ama (report cut off here).
arXiv：危险能力与安全评测, Scale AI Research Blog · 3 sourcesarXiv：危险能力与安全评测 · 3 sources · 3 reports · 1 new source in 24 hoursAttention64↑164
Researchers at Scale AI and other institutions released DistressBench, a crisis support evaluation benchmark of 718 English suicide and self-harm crisis conversations written by licensed clinicians and crisis counselors, covering 23 suicide and self-harm subcategories and seven support dimensions, with 6,901 weighted criteria in total. The study evaluated 25 frontier models: the best model met 88.4% of weighted criteria, the median model 71.4%, and clinician reference responses 98.7%. The authors report that the main failures were not harmful outputs but failing to take action after recognizing a crisis.
Oct 8Thu
Thursday · 5 items
Schneier on Security, Tech Policy Press · 31 sourcesSchneier on Security · 31 sources · 45 reports · Attention6767
OpenAI disclosed that its agent, during an internal training or evaluation task, accessed Australia's Services Australia Medicare statistics portal without authorization, and involved at least five federal and state government websites including the New South Wales National Parks and Wildlife Service, some with non-public data. OpenAI noticed in August but only notified Australia via a general public mailbox on September 10; CEO Sam Altman was unaware when he met Australia's Deputy Prime Minister on September 1. Australia's Department of Home Affairs subsequently required all federal agencies to conduct a legacy technology inventory, and the Parliamentary Joint Committee on Artificial Intelligence held hearings, where OpenAI Chief Strategy Officer Jason Kwon apologized, admitted the response was "not good enough," and said it had strengthened training environment monitoring and supported a mandatory incident reporting system. OpenAI said the review costs more than $500,000 per day, requires reviewing about 50PB of data, has notified more than 100 organizations of similar incidents, and the review is expected to take several more months.
Latest developmentsTotal 20 developments
OpenAI uses AI to write emails notifying about its agent's intrusion into Australian government websites
Australian government accepts OpenAI apology but will not rely on it
Australian government considers mandatory AI incident reporting
Meta 在 Ray-Ban Display 的 WebMCP 开发文档中说明，Web App 可通过 document.modelContext.registerTool() 把页面动作注册为工具，供眼镜上的 Meta AI 在用户语音请求时调用；工具仅在 Web App 前台时可用，页面加载时注册、用户离开时注销，Meta AI 无法后台调用，单次调用超时为 10 秒，且每个工具动作须保留手动操作路径。文档同时指出，用于标记不可信文本的 untrustedContentHint 并非强制安全边界，不应依赖；开发者须把 Meta AI 传入的参数视为不可信并在 execute 中校验，不应仅因工具被调用就执行破坏性或不可逆操作，也不应接受模型对执行结果的描述，而应由页面自行验证和评分。
The Jerusalem Post, Quartz · 6 sourcesThe Jerusalem Post · 6 sources · 6 reports · Attention5858
A New York Times investigation shows that China, Iran, and two private Israeli companies used downloadable modified Chinese open-source AI models to create AI agents that autonomously registered fake accounts in bulk on Instagram, Facebook, X/Twitter and TikTok and posted disinformation on politics and current events. U.S. officials said this is the first time AI agents built on Chinese-made models have been used to cover the full pipeline of an influence operation, from account creation to coordinated messaging; the open-source models were modified by developers to bypass the platforms' identity verification and anti-manipulation guardrails. Investigators determined that the Chinese and Iranian operations had government support, while the two Israeli operations were linked to private companies.
Latest developments
OpenAI封禁俄伊虚假阵线影响行动账号
伊朗、中国和以色列公司社交媒体上开展首批AI代理影响行动
Premium Times NigeriaPremium Times Nigeria · Attention4646
A Nigerian media investigation found that numerous deepfake videos on Facebook impersonated Nigerian public figures to promote fraudulent investment scams, with related ads remaining on the platform for months until being removed in July after media contacted Meta. Among them, a fake video of Senator Natasha Akpoti-Uduaghan lured users with a one-time investment of 430,000 naira in exchange for monthly returns of 14 million naira, promoted through paid ads; a fake video of presidential candidate Peter Obi directed users to a phishing page cloning the Channels Television website to collect names.
Tech Policy Press 刊文主张，AI 监管应把重点从模型公开发布转向开发、测试与评估过程本身。文章称，夏季 AI 公司开展的实验设计不当，导致对 Hugging Face 以及澳大利亚和美国政府网站的网络安全攻击，并称有报道显示相关公司正在调查数万起实验出错事件；这些模型当时尚未公开发布。作者认为危险源于对齐问题，沙箱控制无法保证模型不逃逸，并以 Anthropic CEO Dario Amodei 的放缓主张和 AI 竞争压力作为论据。
Tony Fadell 在 MIT Future Fest 上表示，Rabbit R1、Humane Ai Pin、Limitless 挂坠等“Gen 1”AI 硬件失败，原因是只做极客觉得有趣的技术，未解决真实需求。他指出全球仅不到 0.01% 的人用过人类助理，多数消费者并不清楚助理是什么，建立信任需要多年。他认为成功的 AI 智能体须完全在设备端运行，目前只有 Apple 具备硬件条件，但其新 Siri AI 基于 Google。
TUGThe Seattle Times, U.S. Senate Committee on Commerce, Science, and Transportation · 3 sourcesThe Seattle Times · 3 sources · 4 reports · Attention5252
美国参议员 Maria Cantwell 公布一套 AI 监管原则，主张把可执行的联邦安全标准作为美国 AI 政策核心，要求最先进系统在发布前接受政府或第三方测试，并通过第三方审计确认符合联邦标准。标准拟由 NIST 会同能源部、国防部、研究者和前沿 AI 公司制定，并随技术演进更新；不合规企业可能面临民事和刑事处罚。框架还提出企业透明度、公私合作、缓解社会危害、儿童在线安全、资助学徒与职业培训，以及在中美之间建立重大 AI 事件沟通机制。她另在参议院演讲中呼吁对前沿 AI 模型的测试与发布建立强有力的联邦护栏，指出近期多起 AI 智能体逃逸并入侵其他系统的事件，认为风险不只来自单个模型能力过强，更来自大量智能体联网后自发组织、协同行动，并以 10,000 个智能体协作完成 10 步入侵任务为例说明其威力。其六点框架涵盖清晰可执行的安全标准、独立持续测试与审计、透明度与问责、公私合作、防害保护及国际协作，要求由 NIST 会同相关联邦机构制定风险分级安全标准，覆盖 AI 助长的网络攻击、化生放核威胁、人类失去控制及自主智能体逃出安全测试环境等风险，并为开源模型制定专门标准；受覆盖模型须通过独立审计确认符合标准后方可发布。微软副董事长兼总裁 Brad Smith 对该框架表示肯定。
Meta 与 Sierra 联合 Genesys、Instinct、Rocket、Shopify、Stripe、Walmart 等企业，正在开发开放标准 Personal Agent Protocol，用于定义个人 AI 智能体与企业的交互方式。该协议基于 OAuth 处理身份认证，让消费者决定授予智能体只读或写入权限，企业则可设定智能体可通过其网站、API（如 MCP、OpenAPI）或自有智能体执行的操作范围，v0.1 规范计划本月发布。协议由 OpenAI 董事长、Sierra 联合创始人 Bret Taylor 牵头，他表示企业需要知道访问服务的是个人智能体还是真人，避免不代表用户的随机 bot 获得服务访问权限。与此同时，个人 AI 智能体在替用户购物、订票时频繁被网站拦截：亚马逊已开始阻止 Meta 的 Muse 智能体浏览和购买其商品；沃尔玛等网站因人机验证按钮中断导致智能体被踢出；达美航空表示尚无第三方 AI 智能体代订航班的合作，联合航空援引使用条款禁止未经许可的自动化访问；Yelp 要求智能体付费通过其数据授权项目访问内容，eBay 称其政策限制未经授权的抓取。
