PDA

View Full Version : Yahoo! Slurp Spider



richy rich
22-06-2006, 08:58 AM
Yahoo! Slurp Spider wtf is this, go to "who's online" and there is loads of these online.

Si.
22-06-2006, 09:04 AM
Thats the yahoo search engine spider. Search engines use them to "Crawl" sites which are then indexed in their search index, basically meaning they are looking at the forum so they can list it in their searches.

richy rich
22-06-2006, 09:11 AM
ok tar

I-S
22-06-2006, 01:45 PM
What I find for my forum is that yahoo sends out the most spiders and uses the most bandwidth, but Google produces by far the most results (ie people clicking through from the search engine).

VR4 MAD
22-06-2006, 11:28 PM
Thats the yahoo search engine spider. Search engines use them to "Crawl" sites which are then indexed in their search index, basically meaning they are looking at the forum so they can list it in their searches.

:thinking: Question.......are these 'spiders' able to see into our members areas and index that content too?:speechles

:inquisiti

Kenneth
22-06-2006, 11:38 PM
:thinking: Question.......are these 'spiders' able to see into our members areas and index that content too?:speechles

:inquisiti

No they cant.

I-S
22-06-2006, 11:52 PM
They can only see what an unregistered user can see.