Saturday, January 22, 2011

ScraperWiki, to write and schedule screen scrapers and store the generated data

By Vasudev Ram

I read about ScrapewWiki via this tweet by Tim O'Reilly (@timoreilly)

What is ScraperWiki

Excerpt from the ScraperWiki About page - regarding its license (Gnu Affero GPL) and the technologies used:

[ Yes, the source code for the ScraperWiki site is available under the GNU Affero General Public License. You can download it here.

ScraperWiki is already 99% open source by weight, using as it does Python, Apache, User Mode Linux, Twisted, Orbited, nginx, and CodeMirror, among other things. ]

- Vasudev Ram - Dancing Bison Enterprises

No comments: