@[email protected] to Ask [email protected] • 1 month agoWhat's your favourite search engine?message-square59fedilinkarrow-up153arrow-down14
arrow-up149arrow-down1message-squareWhat's your favourite search engine?@[email protected] to Ask [email protected] • 1 month agomessage-square59fedilink
minus-square@[email protected]linkfedilink5•1 month agoIt’s a meta search engine. It queries other search engines and compiles you results.
minus-square@[email protected]linkfedilink3•1 month agoThat’s a shame, It would be more interesting to run your own crawlers. (Yes I realise that would be computationally intense and hard, but it would nonetheless be cool)
minus-square@[email protected]linkfedilink3•1 month agoThere is probably a neat wget oneliner that could crawl everything on the open web. The real challenge is how to index all the information. That might be a neat Perl oneliner.
It’s a meta search engine. It queries other search engines and compiles you results.
That’s a shame, It would be more interesting to run your own crawlers.
(Yes I realise that would be computationally intense and hard, but it would nonetheless be cool)
There is probably a neat wget oneliner that could crawl everything on the open web. The real challenge is how to index all the information. That might be a neat Perl oneliner.