Looking for a tutorial on web scrapping

• 

  drmike · Member · Feb 12, 2006 at 5:48 pm

  • Copy link
  • Add topic to favorites

  Would you believe right after posting that i don’t know a whole lot about scrapping web pages, I get a request to do something like that.

  *grumble*

  Anyone care to suggest a tutorial or site I can learn about programming a script to do web scrapping?

  Thanks,
  -drmike

• 

  gemstones · Member · Feb 12, 2006 at 7:07 pm

  • Copy link

  You’ll need fetch the html, tell you script where to find the information using regular expressions, then manipulate the results as you see fit.

• 

  drmike · Member · Feb 12, 2006 at 7:27 pm

  • Copy link

  You’ll need fetch the html, tell you script where to find the information using regular expressions, then manipulate the results as you see fit.

  *chuckle* I knew that….

• 

  gemstones · Member · Feb 12, 2006 at 9:04 pm

  • Copy link

  Try googling: “how to” screen scraping

• 

  drmike · Member · Feb 12, 2006 at 9:23 pm

  • Copy link

  Spent twenty minutes or so with Google before. I’ll try that combo though.

  Thanks,
  -drmike

• 

  gemstones · Member · Feb 12, 2006 at 11:04 pm

  • Copy link

  What Language are you going to program this in?

• 

  drmike · Member · Feb 13, 2006 at 1:22 pm

  • Copy link

  Toss up really. I usually stick to PHP now a days but I have a feeling that perl or something done in C would be the way to go.

  -drmike

• 

  gemstones · Member · Feb 15, 2006 at 5:16 pm

  • Copy link

  I’m actually toying with something like this as well but in vb.NET

• 

  drmike · Member · Feb 15, 2006 at 5:36 pm

  • Copy link

  Have to stay away from the Windows stuff. We’re a *NIX house.

  Thanks though,
  -drmike