• Schwim Dandy@lemmy.zip
    link
    fedilink
    arrow-up
    9
    ·
    10 days ago

    I had to shut down my forums due to the scraping. I couldn’t afford the resources required to remain online during their attacks.

    • francisco_1844@discuss.online
      link
      fedilink
      English
      arrow-up
      10
      ·
      10 days ago

      You did not have CloudFlare, or an equivalent, to help against the attacks? If you don’t want a service there are some opensource solutions that should help minimize AI traffic

      • Shin@piefed.social
        link
        fedilink
        English
        arrow-up
        3
        ·
        9 days ago

        Often this isn’t enough. They protect but aren’t perfect, and on the lower tiers they have “good AÍ/scrappers” which are allowed to pass.

        on my servers in very aggressive on his hard I block then. And even so there is still many many bots that pass.