Developers say aggressive AI crawlers are overwhelming open-source infrastructure; LibreNews: up to 97% of some projects' traffic comes from AI companies' bots (Benj Edwards/Ars Technica)

Benj Edwards / Ars Technica: Developers say aggressive AI crawlers are overwhelming open-source infrastructure; LibreNews: up to 97% of some projects' traffic comes from AI companies' bots  —  Software developer Xe Iaso reached a breaking point earlier this year when aggressive AI crawler traffic from Amazon overwhelmed …

Mar 26, 2025 - 14:23
 0
Developers say aggressive AI crawlers are overwhelming open-source infrastructure; LibreNews: up to 97% of some projects' traffic comes from AI companies' bots (Benj Edwards/Ars Technica)

Benj Edwards / Ars Technica:
Developers say aggressive AI crawlers are overwhelming open-source infrastructure; LibreNews: up to 97% of some projects' traffic comes from AI companies' bots  —  Software developer Xe Iaso reached a breaking point earlier this year when aggressive AI crawler traffic from Amazon overwhelmed …