OpenAI cut the live internet out of training its most powerful models: a rule for all runs

On Oct 23, OpenAI said its most powerful models are trained without the live internet. Instead of websites, they use an offline environment with indexed and cached web content, where the model cannot affect external systems.