scRUBYt! is a simple to learn and use, yet powerful web scraping toolkit written in Ruby. The idea behind making scRUBYt! was to show a few simple concepts of Web extraction as a practical extension of this tutorial.
Here we go again: after so much posts and discussions, it seems there are still plenty of problems with installing scRUBYt! on Ubuntu, which were not addressed even by all the articles that appeared here. After some of the scRUBYt! users hunted down even more of them, I will try to sum up a really working HOWTO:
sudo apt-get install build-essential ruby ri rdoc ruby1.8-dev libopenssl-ruby1.8
Important! - make sure you have installed libopenssl-ruby1.8 - and not libopenssl-ruby for example.
If you have installed all of this, you can follow the standard installation. to install mechanize, hpricot and scRUBYt! (hint: it’s just sudo gem install-ing all three of them).
If you know a problem with installing or something that is still not working even if you have installed everything according to this tutorial, please let me know!
June 18th, 2007 at 3:31 pm
The above doesn’t work for me - Ubuntu 7.04 (x64), Ruby 1.8.6. Here’s a simple program:
—–
require ‘rubygems’
require ’scrubyt’
google_data = Scrubyt::Extractor.define do
end
—–
When executed, here’s the error:
/usr/local/lib/ruby/siteruby/1.8/rubygems/customrequire.rb:27:in
gem_original_require': no such file to load -- openssl (LoadError)require’from /usr/local/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:27:in
from /usr/local/lib/ruby/1.8/net/https.rb:102
from /usr/local/lib/ruby/siteruby/1.8/rubygems/customrequire.rb:27:in
gem_original_require'require’from /usr/local/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:27:in
from /usr/local/lib/ruby/gems/1.8/gems/mechanize-0.6.8/lib/mechanize.rb:16
from /usr/local/lib/ruby/siteruby/1.8/rubygems/customrequire.rb:32:in
gem_original_require'require’from /usr/local/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:32:in
from /usr/local/lib/ruby/gems/1.8/gems/scrubyt-0.3.0/lib/scrubyt.rb:7
from /usr/local/lib/ruby/siteruby/1.8/rubygems/customrequire.rb:32:in
gem_original_require'require’from /usr/local/lib/ruby/site_ruby/1.8/rubygems/custom_require.rb:32:in
from test.rb:2
Any ideas? I gave up trying to get this working with WinXP (x64).
June 19th, 2007 at 2:59 am
I am pretty sure you are missing libopenssl-ruby1.8 (or some variant) or 1.8.6 does not like libopenssl-ruby1.8 or mechanize…
August 9th, 2007 at 11:44 pm
it seem libopenssl-ruby1.8 can not be found anywhere?
ERROR: While executing gem … (Gem::GemNotFoundException)
Could not find libopenssl-ruby1.8 (> 0) in any repository
February 4th, 2008 at 7:46 pm
hi
I was getting an error not being able to find net/https, installing the missing from the above listed in your blog post fixed my problem