I have been looking for the some best technology that can used for Scrapping.
Currenly my project uses Perl:LWP with regex to scrape info. I find a lot of tools running under different platform. E.g. Perl HTML XML Parsers, Java, Jscript, .NET. and many many modules like Hpricot, ,Mechanize, Ruby, Ruby on rails.
Which one would be the preferred one ?