OpenAI makes it easier for websites to express AI training preferences

OpenAI announced it will support a common signal in robots.txt through which websites can express, in one place, to multiple participating vendors whether their content is used for foundational generative AI training. Previously, website operators had to separately identify and maintain rules for each vendor's crawler; a shared signal can reduce this work. OpenAI plans to implement the signal within the next few months and will publish implementation details at that time; existing robots.txt crawler controls will continue to apply and be respected. The signal draws on ongoing work of the IETF AI Preferences working group; OpenAI announced it jointly with other participants in the working group and encourages other AI vendors to support the signal as well.