You're viewing a single thread.
59 comments
-
My own self-hosted SearXNG.
-
How does that work, does it go out and start indexing the internet for you?
-
It's a meta search engine. It queries other search engines and compiles you results.
-
That's a shame, It would be more interesting to run your own crawlers.
(Yes I realise that would be computationally intense and hard, but it would nonetheless be cool)
-
There is probably a neat wget oneliner that could crawl everything on the open web. The real challenge is how to index all the information. That might be a neat Perl oneliner.
-
-
-
-
59 comments