10

8

6

4

2


9.9

9.6
Scrapy

9.5
0.0
pyspider

9.1
0.0
requests-html

8.9
0.0
portia

7.7

4.6
MechanicalSoup

7.2
0.0
RoboBrowser

23 Web Crawling packages and projects

  • Scrapy

    9.9 9.6 L4 Python
    Scrapy, a fast high-level web crawling & scraping framework for Python.

  • pyspider

    9.5 0.0 L3 Python
    DISCONTINUED. A Powerful Spider(Web Crawler) System in Python.

    • InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
    Promo www.influxdata.com
    InfluxDB Logo

  • requests-html

    9.1 0.0 Python
    Pythonic HTML Parsing for Humans™

  • portia

    8.9 0.0 L2 Python
    Visual scraping for Scrapy

  • MechanicalSoup

    7.7 4.6 L4 Python
    A Python library for automating interaction with websites.

  • RoboBrowser

    7.2 0.0 L4 Python
    A simple, Pythonic library for browsing the web without a standalone web browser.

  • cola

    6.4 0.0 L3 Python
    A high-level distributed crawling framework.

  • Grab

    6.4 3.0 L3 Python
    Web Scraping Framework

  • PSpider

    6.4 0.0 Python
    简单易用的Python爬虫框架，QQ交流群：597510560

  • feedparser

    6.3 7.2 L3 Python
    Parse feeds in Python

  • Scrapely

    6.1 0.0 HTML
    A pure-python HTML screen-scraping library

  • gain

    6.0 0.0 Python
    Web crawling framework based on asyncio.

  • Sukhoi

    4.2 0.0 Python
    Minimalist and powerful Web Crawler.

  • Google Search Results in Python

    4.1 5.0 Python
    Google Search Results via SERP API pip Python Package

  • MSpider

    4.0 0.0 Python
    Spider

  • reader

    3.4 8.9 Python
    A Python feed reader library.

  • spidy Web Crawler

    3.3 0.0 Python
    The simple, easy to use command line web crawler.

  • Crawley

    2.7 0.0 Python
    Pythonic Crawling / Scraping Framework based on Non Blocking I/O operations.

  • brownant

    2.6 0.0 Python
    Brownant is a web data extracting framework.

  • Demiurge

    2.1 0.0 L5 Python
    PyQuery-based scraping micro-framework.

  • Pomp

    1.6 0.0 L5 Python
    Screen scraping and web crawling framework

  • FastImage

    1.0 0.0 L4 Python
    Python library that finds the size / type of an image given its URI by fetching as little as needed

  • Mariner

    0.4 0.0 Python
    This a is mirror of Gitlab repository. Open your issues and pull requests there.
SaaSHub - Software Alternatives and Reviews
featured www.saashub.com

Popular Comparisons

Add another 'Web Crawling' Package