Popularity
4.1
-
Activity
9.4
Growing
352
18
82

Description

Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.

For more information including a list of features check the Scrapy homepage at: http://scrapy.org

Code Quality Rank: L4
Programming language: Python
License: BSD 3-clause "New" or "Revised" License
Tags: HTTP     Web Crawling     Application Frameworks     Internet     WWW     Scrapy    
Latest version: v1.8.0

Scrapy alternatives and similar packages

Based on the "Web Crawling" category

Do you think we are missing an alternative of Scrapy or a related project?

Add another 'Web Crawling' Package