Popularity
9.9
Stable
Activity
9.1
Declining
42,247
1,815
9,417

Description

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

For more information including a list of features check the Scrapy homepage at: http://scrapy.org

Code Quality Rank: L4
Programming language: Python
License: GNU General Public License v3.0 or later
Tags: HTTP     Web Crawling     Application Frameworks     Internet     WWW     Scrapy    
Latest version: v2.4.1

Scrapy alternatives and similar packages

Based on the "Web Crawling" category.
Alternatively, view Scrapy alternatives based on common mentions on social networks and blogs.

Do you think we are missing an alternative of Scrapy or a related project?

Add another 'Web Crawling' Package