Bookmark · 28 March 2024, 16:24 GitHub - ai-robots-txt/ai.robots.txt: A list of AI agents and robots to block. botsmlfauxpenpinboard
Bookmark · 28 December 2023, 22:15 Dark Visitors - A list of known AI agents on the internet mlbotspinboard
Bookmark · 11 November 2022, 08:47 Block web scanners with ipset & iptables botssecuritymonitoringpinboard
Bookmark · 9 August 2021, 22:21 Manage /robots.txt in Datasette core, block robots by default · Issue #1426 · simonw/datasette · GitHub apisbotsreferencepinboard