yqccv9v3li8o @ yqccv9v3li8o @lemmy.sdf.org Posts 0Comments 2Joined 8 mo. ago
yqccv9v3li8o @ yqccv9v3li8o @lemmy.sdf.org
Posts
0
Comments
2
Joined
8 mo. ago
Why should the crawler be blockable? That only brings disadvantages for a search engine. There is no sensible reason to allow Google but exclude other search engines.
I agree that Brave is problematic and most of the criticisms are also legitimate. But the point about the crawlers is not really a problem. If you respect the wish of websites to be indexed exclusively by Google, you support Google's monopoly and prevent alternative search engines from having similarly good results.