2w ago

How to combat large amounts of Ai scrapers

everytime i check nginx logs its more scrapers then i can count and i could not find any good open source solutions

You're viewing a single thread.

54 comments

crowdsec is arguably not completely open source, but I'm very satisfied with it.
- The scraper blocklist on crowdsec requires a paid subscription, though, or did you find another workaround?
  
  I don't remember how I set it up a long time ago. But when I look at my server logs I only see myself.
  Afaik I just added the biggests lists. But I don't remember.

54 comments