Skip to content

Translation in progress Some entries still include text in the original language.

开源模型安全 · News

Oct 13 · Tuesday

开源模型安全 · News

Latest publications and developments
Oct 8Thu
  1. The Jerusalem Post, Quartz · 6 sourcesThe Jerusalem Post · 6 sources · 6 reports · 58

    Iranian, Chinese and Israeli companies accused of using AI agents to run influence operations

    A New York Times investigation shows that China, Iran, and two private Israeli companies used downloadable modified Chinese open-source AI models to create AI agents that autonomously registered fake accounts in bulk on Instagram, Facebook, X/Twitter and TikTok and posted disinformation on politics and current events. U.S. officials said this is the first time AI agents built on Chinese-made models have been used to cover the full pipeline of an influence operation, from account creation to coordinated messaging; the open-source models were modified by developers to bypass the platforms' identity verification and anti-manipulation guardrails. Investigators determined that the Chinese and Iranian operations had government support, while the two Israeli operations were linked to private companies.

    Latest developments
    1. OpenAI bans accounts from Russian and Iranian fake front influence operations

    2. First AI agent influence operations from Iranian, Chinese, and Israeli companies on social media

Oct 6Tue
  1. GitHub 安全公告GitHub 安全公告 · 46

    vLLM audio processor cache memory exhaustion vulnerability

    vLLM disclosed a MOSS-Audio audio processor cache memory exhaustion vulnerability: when serving the MOSS-Audio model, request-level processor configurations enter an unbounded cache, and repeated different configurations or oversized allocations can exhaust the API process's memory or severely degrade it. Any client with access to /tokenize can trigger it; this endpoint is not protected by --api-key's route authentication, so the API key itself cannot replace external access control. The GitHub advisory marks affected versions as > 0.24.0, < 0.31.0 and the fixed version as 0.31.0.

Oct 2Fri
  1. X @MinLiBuildsX @MinLiBuilds · 14

    PewDiePie banned for distilling OpenAI outputs to train local model

    PewDiePie released a local model Ajax, fine-tuned on Qwen 3.5 9B. He tried using distilled OpenAI model outputs as seed data and studied a paper on decrypting reasoning tokens. His account was banned twice; after appealing the ban, he ran it again and got banned.

Sep 21Mon
  1. 纽约时报中文网 · 55

    伊朗、中国和以色列相关方被指用开源AI智能体开展影响力行动

    美国官员和安全研究人员称,近几个月伊朗、中国以及以色列境内某些组织利用中国开源AI模型创建可自主运行的智能体,在Instagram、Facebook、X和TikTok上批量开设虚假账户并散布政治虚假内容,把网络影响力行动的速度和规模提升到人工难以达到的程度。官员称这是中国模型支持的人工智能智能体首次被用于影响力行动的每个阶段,从创建虚假账户到协调信息发布,操作者多数情况下关闭了模型原有的安全防护。伊朗的国家支持行动冒充生活在美国大城市的普通美国人,在评论中标记记者和政治人士,传播网络梗和反共和党观点,近8万人关注了这些AI创建的账户,账户在今年上半年活跃。以色列方面,总部位于特拉维夫、由前NSO集团员工于2023年创立的IntelEye被指在今年夏天发起其中一宗行动,在四个平台创建数以千计账户并回复有关以色列下月全国选举的帖子。

You have reached the end