AI tools · official-source news

OpenAI plans a shared AI-training preference signal

OpenAI says it will honour a shared robots.txt signal in the coming months. Existing training and search crawler controls remain separate.

Edited by Clinton FeyisitanAnnounced Published

Review scope: Announcement and current crawler documentation; prospective implementation, no crawler configuration or legal assessment. Sources read 31 October 2026.

Announced now, implementation still ahead

OpenAI’s 30 October announcement commits to honouring a common robots.txt preference for foundational generative AI training. It describes implementation in the coming months and says further implementation details will follow. This is not a claim that the new signal is already active everywhere.

Existing controls continue

OpenAI says the shared signal will not replace its existing crawler controls. Its current documentation separates GPTBot, which can collect training content, from OAI-SearchBot, which supports ChatGPT search. A website can set different preferences for those purposes.

Why the distinction matters to a publisher

Training preferences, search discovery and user-requested page visits are different scopes. OpenAI documents ChatGPT-User separately for user-triggered actions and says robots.txt rules may not apply to those visits. A training preference therefore should not be described as a universal block on every AI access path.

Scope of this report

This is a reading of the announcement and crawler documentation, not legal advice or an enforcement test. Fewertools has not changed its robots.txt, firewall or Google access as part of this news update.

Sources and related reading

ChatGPT product notes · More dated AI updates