Python web scraping and crawling framework

Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

This package provides the python-scrapy script and modules.

Related packages: python-scrapy-doc

Maintainer information

This software package is maintained for (Neuro)Debian by the follow individuals and/or groups:

Maintainer avatar
NeuroDebian Maintainers
Maintainer avatar
Ignace Mouzannar

In order to get support, or to get in touch with a maintainer, please click the ‘Help’ button at the top of the page.

Advanced user information

Version control system available: Browse sources

Package availability chart
Distribution Base version Our version Architectures
Debian GNU/Linux 6.0 (squeeze) 0.8-3    
Debian GNU/Linux 7.0 (wheezy) 0.14.4-1    
Debian GNU/Linux 8.0 (jessie) 0.24.2-1 1.0.0-1~nd80+1 i386, amd64, sparc
Debian testing (stretch) 1.0.0-1 1.0.0-1~nd90+1 i386, amd64, sparc
Debian unstable (sid) 1.0.0-1 1.0.0-1~nd+1 i386, amd64, sparc
Ubuntu 10.04 LTS “Lucid Lynx” (lucid) 0.8-2    
Ubuntu 12.04 LTS “Precise Pangolin” (precise)    
Ubuntu 14.04 “Trusty Tahr” (trusty) 0.14.4-1 1.0.0-1~nd14.04+1 i386, amd64, sparc
Ubuntu 14.10 “Utopic Unicorn” (utopic) 0.24.2-1 1.0.0-1~nd14.10+1 i386, amd64, sparc
Ubuntu 15.04 “Vivid Vervet” (vivid) 0.24.2-1 1.0.0-1~nd15.04+1 i386, amd64, sparc
The source code for this portal is licensed under the GPL-3 and is available on GitHub.