Popularity
2.7
Growing
Activity
0.6
Declining
199
15
49

Description

Spidy (/spˈɪdi/) is the simple, easy to use command line web crawler. Given a list of web links, it uses Python requests to query the webpages, and lxml to extract all links from the page. Pretty simple!

Created by rivermont (/rɪvɜːrmɒnt/) and FalconWarriorr (/fælcʌnraɪjɔːr/), and developed with help from these awesome people. Looking for technical documentation? Check out DOCS.md Looking to contribute to this project? Have a look at CONTRIBUTING.md, then check out the docs.

Programming language: Python
License: GNU General Public License v3.0 only

spidy Web Crawler alternatives and related packages

Based on the "Web Crawling" category

Do you think we are missing an alternative of spidy Web Crawler or a related project?

Add another 'Web Crawling' Package

spidy Web Crawler Recommendations

There are no recommendations yet. Be the first to promote spidy Web Crawler!

Have you used spidy Web Crawler? Share your experience. Write a short recommendation and spidy Web Crawler, you and your project will be promoted on Awesome Python.
Recommend spidy Web Crawler

Recently added spidy Web Crawler resources

Do you know of a usefull tutorial, book or news relevant to spidy Web Crawler?
Be the first to add one!