Nov 10, 2017

An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.

Scrapy (/ˈskreɪpi/ SKRAY-pee) is a free and open source web crawling framework, written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general purpose web crawler.
It is currently maintained by Scrapinghub Ltd., a web scraping development and services company.