Nov 10, 2017

An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.

Scrapy (/ˈskreɪpi/ SKRAY-pee) is a free and open source web crawling framework, written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general purpose web crawler.
It is currently maintained by Scrapinghub Ltd., a web scraping development and services company.
Post a Comment

Featured Post

Modern tar recognizes the file format

One command works with any supported compression method. tar xf archive.tar.xz tar xf archive.tar.gz tar xf archive.tar etc. ...