Web Crawling packages

Showing projects tagged as Utilities and Web Crawling

  • trafilatura

    6.5 8.4 Python
    Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
  • Goose3

    4.2 6.6 HTML
    A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  • reader

    3.1 9.2 Python
    A Python feed reader library.
  • Python Testing Crawler

    1.5 0.0 Python
    A crawler for automated functional testing of a web application