Topic: scraping

Scrapy, a fast high-level web crawling & scraping framework for Python.

A scalable web crawler framework for Java.

Free Web Scraping Tool

Creating Scrapy scrapers via the Django admin interface

A framework for creating semi-automatic web content extractors

:scissors: High performance, multi-threaded image scraper

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Crawl all unique internal links found on a given website

static site version of Programming Historian

Functional HTML scraping and rewriting with CSS in OCaml.

PDF versions of Geeks for Geeks articles. Compiled into book form.

Command Line Tool to download torrents from kat.ph https://pythonhosted.org/katastrophe/