Popularity
9.9
Stable
Activity
9.2
Growing
34,100
1,830
7,983

Description

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

For more information including a list of features check the Scrapy homepage at: http://scrapy.org

Code Quality Rank: L4
Programming language: Python
License: BSD 3-clause "New" or "Revised" License
Tags: HTTP     Web Crawling     Application Frameworks     Internet     WWW     Scrapy    
Latest version: v1.7.3

Scrapy alternatives and similar packages

Based on the "Web Crawling" category

Do you think we are missing an alternative of Scrapy or a related project?

Add another 'Web Crawling' Package