cm0002@toast.ooo to Opensource@programming.dev · 10 days agoDue to relentless AI scrapers notabug.org is currently down.notabug.orgexternal-linkmessage-square3linkfedilinkarrow-up116arrow-down11cross-posted to: opensource@lemmy.ml
arrow-up115arrow-down1external-linkDue to relentless AI scrapers notabug.org is currently down.notabug.orgcm0002@toast.ooo to Opensource@programming.dev · 10 days agomessage-square3linkfedilinkcross-posted to: opensource@lemmy.ml
minus-squareSchwim Dandy@lemmy.ziplinkfedilinkarrow-up9·10 days agoI had to shut down my forums due to the scraping. I couldn’t afford the resources required to remain online during their attacks.
minus-squarefrancisco_1844@discuss.onlinelinkfedilinkEnglisharrow-up10·10 days agoYou did not have CloudFlare, or an equivalent, to help against the attacks? If you don’t want a service there are some opensource solutions that should help minimize AI traffic
minus-squareShin@piefed.sociallinkfedilinkEnglisharrow-up3·9 days agoOften this isn’t enough. They protect but aren’t perfect, and on the lower tiers they have “good AÍ/scrappers” which are allowed to pass. on my servers in very aggressive on his hard I block then. And even so there is still many many bots that pass.
I had to shut down my forums due to the scraping. I couldn’t afford the resources required to remain online during their attacks.
You did not have CloudFlare, or an equivalent, to help against the attacks? If you don’t want a service there are some opensource solutions that should help minimize AI traffic
Often this isn’t enough. They protect but aren’t perfect, and on the lower tiers they have “good AÍ/scrappers” which are allowed to pass.
on my servers in very aggressive on his hard I block then. And even so there is still many many bots that pass.