Drunk & Root@sh.itjust.works to Selfhosted@lemmy.worldEnglish · 7 months agoHow to combat large amounts of Ai scrapersmessage-squaremessage-square47linkfedilinkarrow-up10arrow-down10file-text
arrow-up10arrow-down1message-squareHow to combat large amounts of Ai scrapersDrunk & Root@sh.itjust.works to Selfhosted@lemmy.worldEnglish · 7 months agomessage-square47linkfedilinkfile-text
everytime i check nginx logs its more scrapers then i can count and i could not find any good open source solutions
minus-squaremadiator2011@px.madiator.comlinkfedilinkEnglisharrow-up0·7 months agoIn my case I use https://www.bunkerweb.io/ as my proxy for that, but there are other tools like for example https://github.com/TecharoHQ/anubis
minus-squareDrunk & Root@sh.itjust.worksOPlinkfedilinkEnglisharrow-up0·7 months agobunkerweb looks intresting
In my case I use https://www.bunkerweb.io/ as my proxy for that, but there are other tools like for example https://github.com/TecharoHQ/anubis
bunkerweb looks intresting