Four AI companies support a unified training opt-out signal

1. 11:30
   X@websitebooster_· Discussion

   [Convenient] By writing just one line in robots.txt, you can tell four companies' AI "don't use this for training" OpenAI, Google, Microsoft and Anthropic respect the common token __usage_ai-training…(opens the original post in a new tab)
2. 10:55
   X@ParawayneCN· Discussion

   Your website doesn't want to be used for AI training? From now on you won't have to block crawlers one by one. OpenAI, Google, Microsoft and Anthropic agree to share the robots.txt signal __usage_ai-training: add one Disallow line and you can declare opting out of training to multiple companies at once. Anthropic…(opens the original post in a new tab)
3. 10:40
   X@RongfengX0018· Discussion

   OpenAI, Google, Microsoft and Anthropic agree to respect `__usage_ai-training` in robots.txt: creators finally have one more line for a "refuse training" option. Implementation timing varies by company. Having an option does not mean there is a police force right away. Voluntary…(opens the original post in a new tab)
4. 07:00
   X@TaylorChristof2· Discussion

   One AI-training preference instead of per-provider rules: OpenAI plans to honor a shared robots.txt signal in coming mo…(opens the original post in a new tab)
5. 04:50
   X@jevlorde· Discussion

   openai / google / microsoft / anthropic agreed on a shared robots.txt opt-out for training (__usage_ai-training). one…(opens the original post in a new tab)
6. 00:51
   X@TestedAIHQ· Discussion

   OpenAI, Google, Microsoft and Anthropic will honor one shared robots.txt token to opt out of AI training (User-Agent: _…(opens the original post in a new tab)

1. 21:26
   X@gurolcanbek· Discussion

   A crawler can fetch a page even when its publisher says no to AI training. That's the distinction in the new robots.tx…(opens the original post in a new tab)
2. 20:14
   X@Ysxz5Z· Discussion

   One robots.txt line now opts you out of AI training at four labs. It won’t un-train what’s already scraped. Named syst…(opens the original post in a new tab)
3. 14:31
   WebcnBeta· Media coverage

   Company A/Company O/Google/Microsoft jointly drafted a statement refusing AI training; websites only need to add the statement to block it.(opens the original post in a new tab)
4. 10:47
   X@dhanyqaz· Discussion

   after 3 years of writing a separate robots.txt rule for every AI crawler, you now get one line. it doesn't work yet. U…(opens the original post in a new tab)
5. 02:39
   Hacker NewsHacker News· Discussion

   Making it easier for websites to express AI training preferences(opens the original post in a new tab)
6. 02:21
   X@mordiaky· Discussion

   the new shared AI-training opt-out is one robots.txt line: User-Agent: __usage_ai-training then Disallow: /. it leaves…(opens the original post in a new tab)
7. 01:11
   iThome (Taiwan)

   4 major AI companies support a common AI training preference signal; websites will be able to set it uniformly via robots.txt

   Google, OpenAI, Microsoft and Anthropic will support a common AI training preference signal. Website administrators will in the future be able to use the __usage_ai-training marker in robots.txt to uniformly express whether web page content is permitted to be used for generative AI model training, without having to separately maintain each company's rules. The marker follows existing robots.txt syntax; after specifying it in the User-Agent field, Disallow or Allow rules can be applied to the entire site or specific directories. It controls the purpose for which content is used, not crawler access permissions; refusing AI training does not mean prohibiting search engines from crawling or indexing the web page, and existing control rules targeting individual companies can still continue to be used. Anthropic has begun implementation, OpenAI is expected to support it within the next few months, Google plans to introduce it in 2027, and Microsoft is expected to support it on February 1, 2027.

8. 00:44
   RedditReddit r/OpenAI· Discussion

   OpenAI will honor a shared robots.txt signal so websites can opt out of AI training(opens the original post in a new tab)
9. 00:10
   X@JerryTokn· Discussion

   If you run a website and didn't want your writing used to train AI models, until now you had to write a separate robots…(opens the original post in a new tab)

1. 22:19
   WebIThome (China)· Media coverage

   OpenAI, Google, Microsoft and Anthropic jointly promote an AI data scraping opt-out standard(opens the original post in a new tab)
2. 21:52
   X@goldenagemoy· Discussion

   openai, google, microsoft and anthropic all say they'll honor one shared robots.txt line for opting out of ai training:…(opens the original post in a new tab)
3. 21:06
   X@elliottaix· Discussion

   Opting your site out of AI training is about to take one robots.txt group, not four: User-Agent: __usage_ai-training D…(opens the original post in a new tab)
4. 18:02
   X@akatsuki_cs· Discussion

   A new feature has arrived that lets websites easily express permission or refusal for AI training🌐 So that site operators can state their own intent. #AI #Privacy #OpenAI https://openai.com/index/helping-websites-ex…(opens the original post in a new tab)
5. 17:02
   X@rehanshakir23· Discussion

   Four AI labs agreed on one robots.txt rule to opt out of AI training: __usage_ai-training. It replaces a rule per crawl…(opens the original post in a new tab)
6. 07:31
   WebITmedia AI+· Media coverage

   OpenAI, Google and others express support for collectively specifying refusal of use for AI training via robots.txt(opens the original post in a new tab)
7. 01:38
   X@MikeScott614· Discussion

   Frontier AI rivals unite behind a single web training opt-out standard submitted to the IETF, transforming AI copyright…(opens the original post in a new tab)
8. 01:30
   X@seofrancisco· Discussion

   OpenAI, Google, Microsoft and Anthropic say they'll honor one robots.txt group for AI training opt-outs: __usage_ai-tra…(opens the original post in a new tab)
9. 01:21
   X@ela_euk· Discussion

   One line in robots.txt, four labs out. On October 30, OpenAI, Google, Microsoft, and Anthropic agreed to honor a singl…(opens the original post in a new tab)
10. 01:17
    X@Ahmadsazxz· Discussion

    OpenAI, Google, Microsoft and Anthropic just agreed on one line of robots.txt that lets publishers opt out of AI traini…(opens the original post in a new tab)
11. 01:14
    X@ox5123141739064· Discussion

    OpenAI, Google, Microsoft and Anthropic will honor one robots.txt line that opts a website out of AI training. Simple a…(opens the original post in a new tab)
12. 01:09
    X@yunchanyq6· Discussion

    https://openai.com/index/helping-websites-express-ai-training-preferences(opens the original post in a new tab)
13. 01:07
    X@usernotfound4xx· Discussion

    One line on a website can now tell four AI giants: don't train on my content. OpenAI, Google, Microsoft and Anthropic…(opens the original post in a new tab)
14. 01:05
    X@Abbas_Mistrah· Discussion

    Google, Microsoft, OpenAI and Anthropic will all honor one robots.txt rule to keep a site out of AI training. Overdue.…(opens the original post in a new tab)
15. 01:03
    X@getmencio· Discussion

    Anthropic, Google, Microsoft and OpenAI have agreed on one robots.txt token to opt out of AI training without leaving s…(opens the original post in a new tab)
16. 01:00
    X@Alex_MendozaMX· Discussion

    Fuentes: anuncio de OpenAI https://openai.com/index/helping-websites-express-ai-training-preferences y The Verge https:…(opens the original post in a new tab)
17. 01:00
    X@gavinz0228· Discussion

    🤖 A rare Big Tech truce: OpenAI, Google, Microsoft & Anthropic will all honor ONE robots.txt signal letting sites o…(opens the original post in a new tab)
18. 00:56
    X@muratkahraman· Discussion

    Until now, websites had to block AI crawlers one by one. The new robots.txt signal could let publishers express their…(opens the original post in a new tab)
19. 00:55
    X@DailyUplink· Discussion

    Four AI giants just agreed on one off switch for training scrapers. OpenAI, Google, Microsoft and Anthropic will honor…(opens the original post in a new tab)
20. 00:52
    X@Vanguardian77· Discussion

    Big AI gave websites a "do not scrape" button. OpenAI, Google, Microsoft & Anthropic back one robots.txt token to…(opens the original post in a new tab)
21. 00:44
    X@ABCDMMviha· Discussion

    My goodness! Shocking! So shocking! 😱😱😱 Four AI companies that usually compete with each other for business have actually agreed on the same set of rules. OpenAI, Google, Microsoft, Anthropic: by adding one line, __usage_ai-training, to robots.txt on a website, one can at once prevent…(opens the original post in a new tab)
22. 00:40
    X@wanerime· Discussion

    OpenAI says it will respect the AI training preferences websites express in robots.txt, but the actual implementation will take a few more months. The internet is finally getting a unified button for "don't feed me to models"—let's see when the button can actually be pressed.https://openai.com/index/helping-w…(opens the original post in a new tab)
23. 00:30
    X@Darren_Builds· Discussion

    One shared AI training preference could spare website owners a growing list of crawler rules. OpenAI plans to honor it…(opens the original post in a new tab)
24. 00:29
    X@iambasitshah· Discussion

    Four rival AI labs just agreed on one line of code. OpenAI, Google, Microsoft and Anthropic will honour a shared robot…(opens the original post in a new tab)
25. 00:28
    X@RyanYanBuilds· Discussion

    Website owners may soon have a simpler way to opt out of AI training. OpenAI, Google and Microsoft have announced supp…(opens the original post in a new tab)
26. 00:27
    X@GlitchyButLoyal· Discussion

    The opt-out that speaks one language — OpenAI, Google, Microsoft, and Anthropic now honor one robots.txt signal for AI…(opens the original post in a new tab)
27. 00:21
    X@Shadowfetch· Discussion

    OpenAI, Google, Microsoft and Anthropic will honor one shared robots.txt signal for AI training 🤝 Sites can state their…(opens the original post in a new tab)
28. 00:20
    X@_MrCode_· Discussion

    Per The Verge, OpenAI, Google, Microsoft and Anthropic will honor one robots.txt rule for AI-training opt-outs: User-Ag…(opens the original post in a new tab)
29. 00:20
    X@juansanchez· Discussion

    The opt-out that speaks one language — OpenAI, Google, Microsoft, and Anthropic now honor one robots.txt signal for AI…(opens the original post in a new tab)
30. 00:08
    X@yaoysc123· Discussion

    On October 30, OpenAI, Google, Microsoft and Anthropic jointly stated their support for the same robots.txt training opt-out signal, __usage_ai-training. Previously, a website that didn't want to be used for training had to write a separate set of rules for each company; in the future, in theory, writing one…(opens the original post in a new tab)
31. 00:07
    X@amohar· Discussion

    openai, google, microsoft and anthropic just agreed on one robots.txt token to opt out of ai training. one line, four l…(opens the original post in a new tab)
32. 00:01
    X@dramireziie· Discussion

    OpenAI apoyará una señal común en robots.txt para que los sitios indiquen si permiten usar su contenido para entrenar m…(opens the original post in a new tab)

1. 23:54
   X@Awesomeshwar· Discussion

   OpenAI, Google, Microsoft and Anthropic agreed on one robots.txt line to opt sites out of AI training, instead of separ…(opens the original post in a new tab)
2. 23:49
   X@TanveerDhool· Discussion

   My take: OpenAI, Google, Microsoft and Anthropic just pledged one shared AI-training opt-out — one robots.txt line inst…(opens the original post in a new tab)
3. 23:47
   X@inspiring_tosh· Discussion

   🚨 AI GIANTS JUST MOVED ON PUBLISHERS OpenAI, Google, Anthropic, Microsoft backing ONE robots.txt opt-out for AI traini…(opens the original post in a new tab)
4. 23:38
   X@ErSonusaini1· Discussion

   All four AI giants agreed on ONE thing 🤝 OpenAI, Google, Microsoft + Anthropic will honor one robots.txt token — __usa…(opens the original post in a new tab)
5. 23:30
   X@rezafadakaran· Discussion

   OpenAI، گوگل، مایکروسافت و Anthropic قراره از یه علامت مشترک توی robots.txt پشتیبانی کنن. صاحب سایت با یه خط میگه «محت…(opens the original post in a new tab)
6. 23:29
   X@conradlotz· Discussion

   Major AI labs back shared robots.txt signal for training opt-out OpenAI, Google, Microsoft, and Anthropic announced th…(opens the original post in a new tab)
7. 23:22
   X@codeAI_travel· Discussion

   AI பயிற்சியில் உங்கள் தளத் தகவல்? OpenAI: robots.txt பொதுக் குறியீட்டுக்கு ஆதரவு. நடைமுறை இன்னும் வரவில்லை. https://o…(opens the original post in a new tab)
8. 23:17
   X@ben100110101· Discussion

   OpenAI, Google, Microsoft and Anthropic will all honor one robots.txt token as an AI-training opt-out. Only Anthropic h…(opens the original post in a new tab)
9. 23:10
   X@RaghavMehtaM1· Discussion

   the shared ai training opt out for robots.txt has a catch a user-agent * disallow doesn't match __usage_ai-training, t…(opens the original post in a new tab)
10. 23:06
    X@ReentryWindow· Discussion

    meanwhile, a truce on scraping: OpenAI, Google, Microsoft and Anthropic will honor one shared robots.txt signal for "no…(opens the original post in a new tab)
11. 23:05
    X@DailyAIOfficial· Discussion

    OpenAI, Google, Microsoft and Anthropic will honor one robots.txt rule that lets sites opt out of AI training. > On…(opens the original post in a new tab)
12. 23:03
    X@globalainomad· Discussion

    How do you tell four AI labs no? One line of text. @OpenAI, @Google, @AnthropicAI and Microsoft now back one robots.tx…(opens the original post in a new tab)
13. 23:02
    X@koussaidev· Discussion

    OpenAI, Google, Microsoft and Anthropic will honour one robots.txt opt-out from AI training: User-Agent: __usage_ai-tra…(opens the original post in a new tab)
14. 23:01
    X@Itzkennybe· Discussion

    Four AI giants finally agree on something 👀 OpenAI, Google, Microsoft and Anthropic will honor one robots.txt line to o…(opens the original post in a new tab)
15. 23:00
    X@elhamteh_eth· Discussion

    📰 OpenAI’s October 30 update: it plans to honor a shared robots.txt signal for website AI-training preferences. Implem…(opens the original post in a new tab)
16. 22:45
    X@allanmelsen· Discussion

    One line in robots.txt can now tell OpenAI, Google, Microsoft and Anthropic not to train on your site. User-Agent: __u…(opens the original post in a new tab)
17. 22:36
    X@MilanGlow· Discussion

    If you run a website and don't want it used to train AI, there's now one robots.txt rule that OpenAI, Google, Microsoft…(opens the original post in a new tab)
18. 22:20
    X@Ali_Baqiassz· Discussion

    Google, openai, anthropic, and microsoft just agreed on one robots.txt line to opt your site out of ai training. One li…(opens the original post in a new tab)
19. 22:18
    X@wuguanzheng2· Discussion

    From now on, robots.txt can have one more line, specifically telling AI whether it can use your site for training. On 10/30, both OpenAI and Google said they would support the __usage_ai-training marker, but for now these are only goals and plans, not yet launched, and behind it is an IETF…(opens the original post in a new tab)
20. 22:17
    X@DreadPirate77· Discussion

    OpenAI, Google, Microsoft and Anthropic say they'll honor one shared robots.txt signal that lets websites opt out of AI…(opens the original post in a new tab)
21. 22:03
    X@SaFeRamirez· Discussion

    ¿Tienes web? Con User-Agent: __usage_ai-training y Disallow: / en robots.txt, OpenAI, Google y Anthropic no entrenarán…(opens the original post in a new tab)
22. 22:02
    X@srjkmrnyk· Discussion

    https://openai.com/index/helping-websites-express-ai-training-preferences(opens the original post in a new tab)
23. 22:01
    X@canary_ai_news· Discussion

    For AI learning opt-out, the common robots.txt token "__usage_ai-training" was endorsed by Google, Microsoft, OpenAI, and Anthropic. However, support is Microsoft in February 2027, Go...(opens the original post in a new tab)
24. 22:01
    X@potent522· Discussion

    OpenAI, Google, and Microsoft said they'll honor one shared robots.txt signal for AI-training opt-outs (Oct 30). The t…(opens the original post in a new tab)
25. 22:00
    X@AIScanSite· Discussion

    Google, Microsoft, OpenAI and Anthropic will honor a shared AI-training opt-out in robots.txt (IETF draft). Anthropic a…(opens the original post in a new tab)
26. 22:00
    X@dave_uncensored· Discussion

    OpenAI, Google, Microsoft and Anthropic now back one shared robots.txt signal that lets websites opt out of AI training…(opens the original post in a new tab)
27. 21:59
    X@TheHour2359· Discussion

    opt out of scraping (2026-10-30) https://www.theverge.com/tech/1023763/openai-google-microsoft-ai-scraping-standard-opt…(opens the original post in a new tab)
28. 21:59
    X@TheHour2359· Discussion

    AI 기업마다 따로 관리하던 학습 거부 설정, 이제 하나의 공통 신호로 통합하려는 움직임이 시작됐습니다. 10월 30일 OpenAI·구글·마이크로소프트·앤트로픽이 웹사이트 운영자가 AI 학습 이용 거부 의사를 여…(opens the original post in a new tab)
29. 21:56
    X@0xsunilpatel· Discussion

    Got a website? Soon one line tells OpenAI, Google, Microsoft and Anthropic "don't train AI on my stuff." It's a shared…(opens the original post in a new tab)
30. 21:55
    X@f3rn4ndoluiz· Discussion

    OpenAI, Google, Microsoft e Anthropic adotarão um sinal único no robots.txt para sites recusarem o uso de conteúdo no t…(opens the original post in a new tab)
31. 21:54
    X@ailabswire· Discussion

    OpenAI, Google, Microsoft and Anthropic just backed one shared opt-out for AI training: a single robots.txt policy toke…(opens the original post in a new tab)
32. 21:48
    X@Adi_GovSecAI· Discussion

    OpenAI, 30 Oct: it will honour the IETF's shared robots.txt policy token, __usage_ai-training, so one signal covers eve…(opens the original post in a new tab)
33. 21:45
    X@ahabgold· Discussion

    🚨 WEBSITE OWNERS COULD SOON GET A POWERFUL NEW WEAPON AGAINST AI SCRAPING. 🤯🌐 SOME OF THE WORLD'S BIGGEST AI COMPANIES…(opens the original post in a new tab)
34. 21:44
    X@saikrishna__777· Discussion

    OpenAI, Google, Microsoft, and Anthropic are backing a new shared robots.txt token that lets websites opt out of AI tra…(opens the original post in a new tab)
35. 21:42
    X@Apurv35904761· Discussion

    OpenAI says it will honor a common robots.txt signal for AI training preferences. Instead of separate rules for every…(opens the original post in a new tab)
36. 21:42
    X@nahjuin· Discussion

    Here’s OpenAI’s take on it https://openai.com/index/helping-websites-express-ai-training-preferences/(opens the original post in a new tab)
37. 21:40
    X@LunaAILab· Discussion

    📌 Source: OpenAI, October 30, 2026. OpenAI announced plans to honor a shared robots.txt signal for AI training prefere…(opens the original post in a new tab)
38. 21:22
    X@itsrasoull· Discussion

    صاحب سایتی و نمیخوای محتوات بره توی آموزش مدلها؟ یه خط به robots.txt اضافه کن: __usage_ai-training نکتهها: فقط مدل…(opens the original post in a new tab)
39. 21:20
    X@2logics· Discussion

    Google (@Google), Microsoft (@Microsoft) and OpenAI (@OpenAI) said on Friday that they will support a shared robots.txt…(opens the original post in a new tab)
40. 21:15
    X@TheAceWheelie· Discussion

    OpenAI's Oct 30 announcement: a shared website signal for AI-training preferences is planned for the coming months. Exi…(opens the original post in a new tab)
41. 20:50
    X@erguoyi· Discussion

    Four AI giants have indeed uniformly supported the __usage_ai-training signal in robots.txt; website owners only need to write two lines to reject the training crawlers of OpenAI, Google, Microsoft and Anthropic at once, without setting rules for each company separately. Rollout times are uneven: Anthropi…(opens the original post in a new tab)
42. 20:42
    X@vicetrader· Discussion

    OpenAI will honor a shared robots.txt signal for AI-training opt-outs, built on the IETF's AI Preferences work. One li…(opens the original post in a new tab)
43. 20:28
    X@nurhayatdev· Discussion

    One robots.txt signal could carry a site’s AI-training preference to multiple providers. 🌐 OpenAI says it will honor t…(opens the original post in a new tab)
44. 20:24
    The Next WebSelected

    Google, Microsoft, OpenAI and Anthropic support a unified AI training opt-out mechanism

    Google, Microsoft, OpenAI and Anthropic announced they will support a unified AI training opt-out signal in robots.txt, so that a website needs only one rule to refuse having its content used for generative AI training. The signal comes from an IETF draft published Friday by Anthropic's Kevin Kelley; websites opt in by adding the policy token __usage_ai-training and listing the paths they do not want used for training. OpenAI plans to implement it within the next few months, Google aims to support it by 2027, and Microsoft will enforce it starting February 1, 2027, replacing the NoArchive and NoCache tags it has used since 2023. The draft states that the signal is only a declaration of content usage preferences rather than a crawling command, and that private agreements between sites and AI companies can override it; the draft was submitted individually, is not endorsed by the IETF, and has no formal status in the standards process.

45. 20:12
    X@PXology· Discussion

    OpenAI, Google, Microsoft ve Anthropic, internet sitesi sahiplerinin içeriklerinin yapay zekâ eğitiminde kullanılmasına…(opens the original post in a new tab)
46. 20:02
    X@lexcxf· Discussion

    6/6 Fontes Google: https://developers.google.com/search/blog/2026/10/ai-training-control OpenAI: https://openai.com/in…(opens the original post in a new tab)
47. 20:02
    X@lexcxf· Discussion

    2/6 Como funciona Hoje você bloqueia robô por robô: Google-Extended, GPTBot e por aí vai. Com o novo sinal, um bloco…(opens the original post in a new tab)
48. 20:00
    X@SauregurkeDEV· Discussion

    One robots.txt rule could replace a list of AI-crawler rules. OpenAI says it will honor a common signal for generative…(opens the original post in a new tab)
49. 19:56
    X@OrigoHubTech· Discussion

    OpenAI, Google, Microsoft and Anthropic back one robots.txt signal to opt out of AI training: __usage_ai-training. It's…(opens the original post in a new tab)
50. 19:44
    X@kabelsalat_info· Discussion

    Heads up if you run a website: the new shared robots.txt signal against AI training (__usage_ai-training) isn't only ab…(opens the original post in a new tab)
51. 19:44
    X@saikrishna__777· Discussion

    Big AI news: OpenAI, Google, Microsoft & Anthropic are backing one simple robots.txt rule that lets any website opt out…(opens the original post in a new tab)
52. 19:40
    X@p_d_y· Discussion

    OpenAI says it will honor a shared robots.txt signal for AI-training preferences, reducing the need for publishers to m…(opens the original post in a new tab)
53. 19:30
    Unite.AI

    Google plans to support shared AI training control via robots.txt

    On October 30, 2026, Google announced plans to support a shared policy token in robots.txt, letting site operators express their training-use preferences to all participating AI providers at once. The mechanism is based on work in the IETF AI Preferences working group and evolves from Google-Extended, which Google has offered since 2023; if a site uses the token to refuse training and does not separately specify Google-Extended, Google will treat it as a refusal of Google-Extended, and each provider may also handle the signal on its own. OpenAI said the same day that it will respect the general robots.txt signal, plans to implement it within months, and calls on other providers to follow; Microsoft also announced adoption, saying its new setting replaces NoArchive and NoCache and applies from February 1, 2027, and sites using the old tags need to update by March 1, 2027.

54. 18:30
    X@Mickerpeng· Discussion

    OpenAI, Google, Microsoft, and Anthropic actually aligned on the same thing on October 30: add a line __usage_ai-training to robots.txt, and all four will not train models on your site. On my side as a site owner: before, I had to block them one by one, pure torment; this time it finally feels like...(opens the original post in a new tab)
55. 18:27
    X@ElonShan· Discussion

    After crawling the entire internet, the four major companies finally jointly released a "no crawling" switch: OpenAI, Google, Microsoft, and Anthropic uniformly support an AI training opt-out signal in robots.txt; one switch blocks all training crawlers, with no need to write it separately for each company. Anthrop...(opens the original post in a new tab)
56. 18:06
    X@Karthikvarmamkv· Discussion

    one robots.txt line will opt you out of ai training at @OpenAI, google, microsoft and @AnthropicAI 🧱 catch: - User-Age…(opens the original post in a new tab)
57. 17:57
    Elets CIO

    OpenAI, Google, Microsoft and Anthropic support a unified AI training opt-out signal; Indian publishers are still not satisfied

    On October 30, OpenAI, Google, Microsoft and Anthropic announced support for a unified AI training opt-out signal, allowing websites to declare once in robots.txt whether their content may be used for generative AI training, replacing the previous practice of setting crawler rules such as GPTBot, Google-Extended and ClaudeBot separately for each company. The signal is based on the AI Preferences draft submitted to the IETF and covers only generative training, not affecting models that perform only non-generative tasks or ordinary search indexing. On the Indian publisher side, DNPA alleged in the Delhi High Court that OpenAI scraped copyright-protected Indian news to train ChatGPT, including websites that had already used robots.txt to refuse AI crawlers, while the shared signal does not cover content already absorbed into existing models, and robots.txt itself has no legal force.

58. 16:01
    PPC LandSelected

    Google, Microsoft, OpenAI and Anthropic support a unified AI training opt-out mechanism

    On October 30, 2026, Google, Microsoft, OpenAI and Anthropic announced they will support a unified robots.txt policy marker, __usage_ai-training, so that a website can declare once and simultaneously refuse all participating vendors from using its content for generative AI training. The marker originates from the IETF individual draft draft-kelley-aipref-training-preference-signal-00, submitted the same day by Anthropic engineer Kevin Kelley; the draft has no formal status in the IETF and expires on May 3, 2027. Microsoft is set to enforce it starting February 1, 2027, Google targets early 2027, OpenAI says it will implement it within months, and Anthropic has begun development but has not given a date. The wildcard User-agent: * does not constitute a training preference declaration, and the marker only constrains content use, not crawling behavior.

59. 04:26
    The Verge AI

    OpenAI, Google, Microsoft and Anthropic support a new standard letting publishers refuse AI scraping

    OpenAI, Google, Microsoft and Anthropic said they will adopt a new standard that lets publishers set their preference to refuse AI scraping once through a unified signal, without having to declare it separately to each company. The shared policy token signal was proposed at the IETF by Kevin Kelley, Anthropic's standards technical lead, and is written into a website's robots.txt file; the four companies said that when they encounter the signal, they will restrict their own AI crawlers' access to the corresponding websites. Implementation progress varies: Anthropic has already adopted the signal, Google and Microsoft plan to support it next year, and OpenAI said it will implement it within the coming months. Microsoft will also offer more granular controls, allowing publishers to opt out of AI training or AI grounding separately, that is, directing models to verified information sources to reduce hallucinations; regardless of preference, websites will still appear in Bing search results.

60. 02:27
    Unite.AI

    OpenAI will honor a generic robots.txt signal expressing AI training preferences

    On October 30, 2026, OpenAI announced that it will honor the general signal in robots.txt, allowing website operators to express AI training preferences to multiple participating AI providers at once. The signal is defined by the individual Internet-Draft draft-kelley-aipref-training-preference-signal-00, drafted by Anthropic's Kevin Kelley; its core is the cross-vendor policy token __usage_ai-training, it does not change the syntax of RFC 9309, and it has not yet received formal IETF status. OpenAI said the move is based on progress in the IETF AI Preferences working group, plans to implement the signal within the coming months and publish implementation details, and calls on other AI providers to follow suit; the existing independent controls for each crawler, such as GPTBot and OAI-SearchBot, remain in effect.

1. 17:30
   OpenAISelected

   OpenAI makes it easier for websites to express AI training preferences

   OpenAI announced it will support a common signal in robots.txt through which websites can express, in one place, to multiple participating vendors whether their content is used for foundational generative AI training. Previously, website operators had to separately identify and maintain rules for each vendor's crawler; a shared signal can reduce this work. OpenAI plans to implement the signal within the next few months and will publish implementation details at that time; existing robots.txt crawler controls will continue to apply and be respected. The signal draws on ongoing work of the IETF AI Preferences working group; OpenAI announced it jointly with other participants in the working group and encourages other AI vendors to support the signal as well.

Current attention 53·Peak in the comparable period 74 (Nov 1 11:00)·Change over the comparable past 24 hours -18%