Websites shut the door on AI agents: Cloudflare blocks them by default from Sep 15

From Sep 15, Cloudflare blocks AI agent crawlers by default on pages with advertising. The rule applies to new customers, new sites and the Free plan. Amazon said Meta Muse agent's access to its site violates its policy, while Walmart became a partner and lets it in.