10

8

6

4

2


9.4
1.2
newspaper

9.3

4.1
TWINT

8.1
0.0
python-goose

7.4
0.0
textract

7.2

2.8
sumy

7.2
0.0
toapi

19 Web Content Extracting packages and projects

  • newspaper

    9.4 1.2 L3 Python
    News, full-text, and article metadata extraction in Python 3. Advanced docs:

  • TWINT

    9.3 4.1 Python
    An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.

    • Scout APM uses tracing logic that ties bottlenecks to source code so you know the exact line of code causing performance issues and can get back to building a great product faster.
    Sponsored scoutapm.com

  • python-goose

    8.1 0.0 HTML
    Html Content / Article Extractor, web scrapping lib in Python

  • textract

    7.4 0.0 HTML
    extract text from any document. no muss. no fuss.

  • sumy

    7.2 2.8 L5 Python
    Module for automatic summarization of text documents and HTML pages.

  • toapi

    7.2 0.0 Python
    Every web site provides APIs.

  • python-readability

    6.6 1.3 HTML
    fast python port of arc90's readability tool, updated to match latest readability.js!

  • html2text

    5.1 3.8 L1 Python
    Convert HTML to Markdown-formatted text.

  • micawber

    3.8 4.5 L5 Python
    a small library for extracting rich content from urls

  • Goose3

    3.6 4.0 HTML
    A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html

  • lassie

    3.6 1.9 L4 HTML
    Web Content Retrieval for Humans™

  • opengraph

    2.9 0.0 L5 Python
    A python module to parse the Open Graph Protocol

  • trafilatura

    2.6 9.1 Python
    Web scraping library and command-line tool for text discovery and extraction (main content, metadata, comments)

  • Haul

    2.4 0.0 L5 Python
    An Extensible Image Crawler

  • inscriptis -- HTML to text conversion library, command line client and Web service

    1.6 5.8 HTML
    A python based HTML to text conversion library, command line client and Web service.

  • sanitize

    1.3 0.0 L4 Python
    Bringing sanity to world of messed-up data

  • htmldate

    1.1 7.2 Python
    Fast and robust date extraction from web pages, from the command-line or within Python

  • Data Extractor

    0.8 7.4 Python
    Combine XPath, CSS Selectors and JSONPath for Web data extracting.

  • JSONPATH

    0.8 6.0 Python
    A query expression for extracting data from JSON.
SaaSHub - Software Alternatives and Reviews
Sponsored www.saashub.com

Popular Comparisons

Add another 'Web Content Extracting' Package