scRUBYt!
WWW::Mechanize and Hpricot on Steroids
Briefly...
scRUBYt! is a simple to learn and use, yet powerful web scraping toolkit written in Ruby. The idea behind making scRUBYt! was to show a few simple concepts of Web extraction as a practical extension of this tutorial.
November 25th, 2007 at 9:39 am
Cool!
I did a presentation on Hpricot at the Spanish Rails Conf this week; my next talk will be about scRUBYt.
November 25th, 2007 at 9:44 am
Great!!! Please let me know how it went
April 24th, 2008 at 6:32 am
Hey, Peter!
Rich here from endorkins.com - just wanted to leave you the URL of the page I couldn’t scrape. Head to http://shopping.yahoo.com/ and click on “Shop by Store”. (I’d paste the URL but it looks like the it is dynamically generated) The links to each store (on all pages) were my target data. I’d love if the new FireWatir integration would fix this! If so, feel free to post a link to my post (http://endorkins.com/?p=3) to show how FireWatir makes scRUBYt! even more powerful than ever. I’ll update the post given your success with the FireWatir-enabled scRUBYt!.
-RIch
P.S. I couldn’t find your email address; feel free to just delete this comment.