web crawlers ?

• 

  harrythehandyman · Member · Aug 19, 2010 at 4:50 pm

  • Copy link
  • Add topic to favorites

  what is a web crawler and can they be used on WP

  The blog I need help with is: (visible only to logged in users)

• 

  raincoaster · Member · Aug 19, 2010 at 9:14 pm

  • Copy link

  They are programs that search engines use to find and follow links and thus map the web. You are not a search engine, therefore you do not need them.

• 

  harrythehandyman · Member · Aug 19, 2010 at 9:44 pm

  • Copy link

  thank you again , harry

• 

  timethief · Member · Aug 19, 2010 at 9:49 pm

  • Copy link

  Hi Harry,
  Remember that Google is your friend … lol :D

  I typed in “what is a web crawler?” and I got an answer is 2 seconds flat.

  A Web crawler is an automated program program, sent out by the search engine, to brows the Internet in a methodical, automated manner. Web crawlers are mainly used to create a copy of all the visited pages for search engine indexing.

• 

  harrythehandyman · Member · Aug 19, 2010 at 10:00 pm

  • Copy link

  thank you tt as always

• 

  timethief · Member · Aug 19, 2010 at 10:04 pm

  • Copy link

  You’re welcome and top ‘o the day to thee, Harry. :) I hope your blogging is going well.