OpenAI bans two AI-assisted fake front influence operations from Russia and Iran
Disrupting AI-enabled “false front” operations
OpenAI announced it banned two covert influence operations that used ChatGPT to support fake front entities, one originating from Russia and one from Iran. The Russian operation was named Dark Clark; its operators used ChatGPT to write internal reports, generate operational content, and control a self-described research platform called Social Research Center through a fake persona named Mia Clark, recruiting unwitting employees in Latin America to produce original content. The disinformation it spread triggered fact-checking and official denials, and was rated Level 5 on the IO Breakout Scale, the first Level 5 operation OpenAI has banned since it began reporting. The Iranian operation was named Bogus Bylines; it used seven fake journalist bylines to pitch nearly 100 long-form articles about the U.S.-Iran conflict to about a dozen small and mid-sized international affairs media outlets, and mass-generated social media comments. The articles were partly rated Level 4, while the comments were only Level 2.
OpenAI 披露两起被其封禁的隐蔽影响行动,其中俄罗斯行动首次达到 IO Breakout Scale 第 5 级,可供研究虚假媒体前台与 AI 辅助影响行动的团队参考。