For years, AI companies treated the open web like an all-you-can-eat buffet. They sent automated crawlers across forums, news ...