Google just announced it’s giving website publishers a way to opt out of having their data used to train the company’s AI models while remaining accessible through Google Search.
many sites have moved to block the web crawler that OpenAI uses to scrape data and train ChatGPT. However, there have been concerns over how to block out Google. After all, websites can’t close off Google’s crawlers completely, or else they won’t get indexed in search.
This is by design. Helps to stop any competition as they will now struggle to get the same amount of training data.