Raj at the Internet Archive

Documentary about the Internet Archive

raj — Thu, 09 May 2013 18:40:30 +0000

By Jonathan Minard, John Behrens, Alexander Porter, and Fearghal O’dea

Internet Archive from Deepspeed media on Vimeo.

Memorial for Aaron

raj — Thu, 17 Jan 2013 18:02:21 +0000

There will be a memorial for Aaron at the Internet Archive on Thrusday, January 24.

The flag at the Internet Archive is flying at half mast in memory of Aaron:

A tiny virtualenv wrapper

raj — Mon, 10 Dec 2012 19:27:51 +0000

Tymm shared his bash function for assisting with virtualenvs. I’ve been using it instead of virtualenvwrapper. Typing `pye` will list your virtualenvs, and typing `pye envname` will activate one of them:

# Enable a python virtualenv
function pye() { 
   if [[ -z "${1}" ]]; then
       echo -e "\x1b[01;34mAvailable virtualenvs:\x1b[00m"
       (cd ~/pyenvs && for i in *; do echo -e "\x1b[01;36m ${i} \x1b[00m"; done)
   else
       . ~/pyenvs/"${1}"/bin/activate; 
   fi
}

The Project Gutenberg Distributed Proofreaders has developed a…

raj — Mon, 01 Oct 2012 23:29:04 +0000

The Project Gutenberg Distributed Proofreaders has developed a font that helps you find OCR mistakes. What a great idea!

http://www.pgdp.net/c/faq/font_sample.php?compare=Arial

The Human Glowstick

raj — Wed, 12 Sep 2012 03:06:59 +0000

For my wonderful coworker Jason Scott:

Amazon forces Unglue.it to Suspend Crowdfunding for Creative Commons eBooks

raj — Thu, 09 Aug 2012 16:33:07 +0000

http://blog.unglue.it/2012/08/09/open-thread-amazon-forces-unglue-it-to-suspend-crowdfunding-for-creative-commons-ebooks/

Parsing UTF-8 webpages with lxml

raj — Thu, 19 Jul 2012 00:01:35 +0000

Here is how to use python and lxml to parse web pages with unicode characters, encoded as utf-8. It would be nice if lxml.html.parse(url) could correctly use the Content-Type HTTP header, but it doesn’t, so you have to tell lxml what encoding to use.

>>> import lxml.etree
>>> url = 'http://hi.wikipedia.org/wiki/मुखपृष्ठ' #utf-8 encoded bytes
>>> url
'http://hi.wikipedia.org/wiki/\xe0\xa4\xae\xe0\xa5\x81\xe0\xa4\x96\xe0\xa4\xaa\xe0\xa5\x83\xe0\xa4\xb7\xe0\xa5\x8d\xe0\xa4\xa0'
 
>>> utf8_html_parser = lxml.etree.HTMLParser(encoding='utf-8')
>>> page = lxml.etree.parse(url, parser=utf8_html_parser)
 
>>> print page.find('head/title').text
विकिपीडिया
>>> page.find('head/title').text
u'\u0935\u093f\u0915\u093f\u092a\u0940\u0921\u093f\u092f\u093e'

http www theatlantic com technology archive 2012 06…

raj — Sat, 09 Jun 2012 21:25:07 +0000

http://www.theatlantic.com/technology/archive/2012/06/a-golden-age-of-books-there-were-only-500-real-bookstores-in-1931/258309/

The Carnegie Libraries of San Francisco

raj — Wed, 23 May 2012 17:31:21 +0000

http://www.spur.org/publications/library/article/carnegie-libraries-san-francisco

After 244 years the Encyclopaedia Britannica is…

raj — Tue, 13 Mar 2012 22:47:01 +0000

“After 244 years, the Encyclopaedia Britannica is going out of print.”

http://mediadecoder.blogs.nytimes.com/2012/03/13/after-244-years-encyclopaedia-britannica-stops-the-presses/