Topic: scraping

Scrapy, a fast high-level web crawling & scraping framework for Python.

A scalable web crawler framework for Java.

Free Web Scraping Tool

Creating Scrapy scrapers via the Django admin interface

A framework for creating semi-automatic web content extractors

:scissors: High performance, multi-threaded image scraper

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Crawl all unique internal links found on a given website

static site version of Programming Historian

Functional HTML scraping and rewriting with CSS in OCaml.

Command Line Tool to download torrents from kat.ph https://pythonhosted.org/katastrophe/

PDF versions of Geeks for Geeks articles. Compiled into book form.