Scrapy is a fast high-level web crawling and web scraping framework, used to
crawl websites and extract structured data from their pages. It can be used for
a wide range of purposes, from data mining to monitoring and automated testing.
For more information including a list of features check the Scrapy homepage at: http://scrapy.org
Scrapy alternatives and related packages
Based on the "Web Crawling" category
* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest. Visit our partner's website for more details.
Do you think we are missing an alternative of Scrapy or a related project?
Scrapy RecommendationsThere are no recommendations yet. Be the first to promote Scrapy!
Have you used Scrapy? Share your experience. Write a short recommendation and Scrapy, you and your project will be promoted on Awesome Python.
Recently added Scrapy resources
Creating a web crawler in Scrapy and scrape data
Deploying Spider to ScrapingHub
Logging into Websites with Scrapy
Running Scrapy as a Standalone Script
Scrapy Tutorial Getting Started
Craigslist Scrapy Spider #1 – Titles
Craigslist Scrapy Spider #2 – One Page
Craigslist Scrapy Spider #3 – Multiple Pages
Craigslist Scrapy Spider #4 – Job DescriptionsTutorial Added by GoTrained // python.gotrained.com // about 1 year ago