Robots.txt
OpenAI to honor shared robots.txt AI training signal
OpenAI said it will honor a shared robots.txt signal so website operators can express AI training preferences to participating providers.