Skip to content
EventPast event

Iranian, Chinese and Israeli companies accused of using AI agents to run influence operations

6 reports6 reporting sourcesLatest report

Start here

AI overview

A New York Times investigation shows that China, Iran, and two private Israeli companies used downloadable modified Chinese open-source AI models to create AI agents that autonomously registered fake accounts in bulk on Instagram, Facebook, X/Twitter and TikTok and posted disinformation on politics and current events. U.S. officials said this is the first time AI agents built on Chinese-made models have been used to cover the full pipeline of an influence operation, from account creation to coordinated messaging; the open-source models were modified by developers to bypass the platforms' identity verification and anti-manipulation guardrails. Investigators determined that the Chinese and Iranian operations had government support, while the two Israeli operations were linked to private companies.

Generated by AI from reports · Updated 3 days ago

Latest developments

2 developments
  1. · 3 reports
    OpenAI bans accounts from Russian and Iranian fake front influence operations
    OpenAI:OpenAI bans two AI-assisted fake front influence operations from Russia and Iran
  2. · 3 reports
    First AI agent influence operations from Iranian, Chinese, and Israeli companies on social media
    The Jerusalem Post:Investigation says groups from China, Iran, and Israel used AI agents to operate fake accounts for influence operations

Progress timeline

Oct 9
  1. The DecoderSelected
    OpenAI disclosed Russian and Iranian influence operations and banned related ChatGPT accounts

    OpenAI disclosed and banned ChatGPT accounts used by two influence operations, one from Russia and one from Iran, both of which used fake identities to plant content with legitimate media outlets rather than merely running social media accounts. The Russian operation, codenamed Dark Clark, spread disinformation in Latin America to smear Ukraine and disrupt local politics, controlling a think tank through fictional personas and potentially involving local employees without their knowledge; forged audio and documents triggered fact-checks and official denials in Ecuador and Peru. OpenAI rated it level 5 out of 6 on the Breakout Scale, calling it the first level 5 case in two and a half years of reporting. The Iranian operation, codenamed Bogus Bylines, used 7 fake journalists to publish nearly 100 articles about the US-Iran conflict on global online media outlets and generated social media comments, but it gained almost no traction. OpenAI said both operations primarily used AI for internal report writing and adapting propaganda content into different languages.

  2. CyberScoopSelected
    OpenAI says Russia and Iran used AI fake journalists and think tanks to influence Western media

    OpenAI disclosed that it has shut down two influence operations from Russia and Iran that used AI tools like ChatGPT to fabricate journalist identities and covert think tanks, and successfully planted narratives in mainstream news media. The Russia-linked "Dark Clark" network focused on Latin American politics and culture, with its fictional persona Mia Clark packaged as the head of the Latin American think tank Social Research Center, producing content mainly to damage Ukraine's reputation in Latin America, and also intervening in political issues in Argentina and Bolivia; OpenAI called it the most sophisticated disguised-identity operation it has disrupted in the past two and a half years, and believes the think tank is actually controlled by Russia. The Iranian operation used similar tools to deliver articles about a US-Iran war, creating at least seven fake journalist identities, and published or republished nearly 100 articles under these bylines in about a dozen small and medium-sized international affairs media outlets, but with little engagement. OpenAI assesses impact on a scale of 1 to 6, rating the Russian operation as 5 and the Iranian operation as 4, significantly higher than most operations that have minimal impact.

Oct 8
  1. OpenAISelected
    OpenAI bans two AI-assisted fake front influence operations from Russia and Iran

    OpenAI announced it banned two covert influence operations that used ChatGPT to support fake front entities, one originating from Russia and one from Iran. The Russian operation was named Dark Clark; its operators used ChatGPT to write internal reports, generate operational content, and control a self-described research platform called Social Research Center through a fake persona named Mia Clark, recruiting unwitting employees in Latin America to produce original content. The disinformation it spread triggered fact-checking and official denials, and was rated Level 5 on the IO Breakout Scale, the first Level 5 operation OpenAI has banned since it began reporting. The Iranian operation was named Bogus Bylines; it used seven fake journalist bylines to pitch nearly 100 long-form articles about the U.S.-Iran conflict to about a dozen small and mid-sized international affairs media outlets, and mass-generated social media comments. The articles were partly rated Level 4, while the comments were only Level 2.

Sep 19
  1. The Jerusalem PostSelected
    Investigation says groups from China, Iran, and Israel used AI agents to operate fake accounts for influence operations

    A New York Times investigation shows that China, Iran, and two private Israeli companies used downloadable, modifiable Chinese open-source AI models to create AI agents that autonomously registered fake accounts in bulk on Instagram, Facebook, X/Twitter, and TikTok and posted political and current affairs disinformation. U.S. officials said this is the first time AI agents from Chinese-made models have been used to cover the full process of a network influence operation, from account creation to coordinating messaging; the open-source models were modified by developers to bypass platform identity verification and anti-manipulation guardrails. Tel Aviv-based company IntelEye, founded by former NSO Group employees, used DeepSeek to create agents that ran about 1,000 accounts posting content both supporting and opposing Netanyahu around the Israeli election; co-founder Maor Sellek said this was defensive research, and the company bought 10,000 accounts but only about 1,000 were put into operation, with limited effect. Meta said it removed the vast majority of such accounts through automated detection and verification systems.

  2. Anadolu Agency
    The New York Times reports Iran and China are using AI agents for new influence operations

    The New York Times reported that groups linked to Iran, China, and Israel have recently used AI on social media for new influence operations, raising concerns among U.S. officials and cybersecurity researchers about AI's ability to operate with minimal human involvement. The operations used freely available Chinese AI models to create autonomous agents; hundreds of agents were deployed on Instagram, Facebook, X, and TikTok to build networks of fake accounts, then post political and current affairs content and coordinate interactions. U.S. officials and researchers said this is one of the earliest known cases in which agents driven by the aforementioned Chinese models participated in nearly the entire process of an influence operation; the operations were relatively crude, but showed that publicly available AI systems can automate operations that previously required significant manpower. The Iranian operation targeted U.S. audiences; AI-generated accounts impersonated ordinary people in major U.S. cities, posted popular memes, tagged journalists and political figures, and promoted views critical of the Republican Party. Nearly 80,000 people followed these accounts, which were active in the first half of this year.

Date not provided
  1. Date not given
    QuartzSelected
    Private companies in Iran, China, and Israel are accused of using AI agents to run social media influence operations

    U.S. officials said private companies in Iran, China, and Israel ran some of the first social media influence operations executed autonomously by AI agents. According to The New York Times, these operations combined downloadable Chinese open-source models with agent software that required no human input, creating fake accounts in bulk on Instagram, Facebook, X, and TikTok and posting fabricated content targeting political issues and current affairs; operators also removed built-in model restrictions meant to prevent generating fake identities or distorting online discussions. Investigators determined the Chinese and Iranian operations had government support, while the two Israeli operations were linked to private companies rather than the state. Separately, The Guardian reported that a pro-Israel website run under the name of a nonexistent think tank published 124 reports totaling over 560,000 words in nine days; its registrant, Piro Inc., has registered with the Department of Justice under the Foreign Agents Registration Act as distributing content on behalf of the Israeli government, and its underlying technology is a commercial service marketed around generating content easily quotable by AI chatbots.

Related discussion

Total 4 items

Attention trend

New sources per day

6 days total8 ·Maximum5(Oct 9)·Today0

  • Oct 8New3 sources (3 outlets,0 accounts)
  • Oct 9New5 sources (5 outlets,0 accounts)
  • Oct 10New0 sources (0 outlets,0 accounts)
  • Oct 11New0 sources (0 outlets,0 accounts)
  • Oct 12New0 sources (0 outlets,0 accounts)
  • Oct 13New0 sources (0 outlets,0 accounts)

Hourly attention

Current attention58·Peak in the comparable period72(Oct 9 19:00)·Change over the comparable past 24 hours -1%

020406080Oct8Oct10Oct11Oct13