OpenAI has announced a web crawler called GPTBot, whose job will be to scour the internet for public data to improve artificial intelligence (AI) offerings, specifically the ChatGPT maker’s large language models GPT-4 and potentially GPT-5. OpenAI trains its machine learning models on public web data.
