Feb 222025 AI crawler wars threaten to make the web more closed for everyone There’s an accelerating cat-and-mouse game between web publishers and AI crawlers, and we all stand to lose.