Selected Tags

Click on a tag to remove it

More Tags

Click on a tag to add it and filter down

Web Content Extracting packages

Showing projects tagged as Web Content Extracting

  • newspaper

    9.4 0.0 L3 Python
    News extraction, article extraction and content curation in Python.

  • requests-html

    9.3 4.2 HTML
    Pythonic HTML Parsing for Humans™

  • python-goose

    8.3 0.0 HTML
    HTML Content/Article Extractor.

  • textract

    7.6 4.4 HTML
    Extract text from any document, Word, PowerPoint, PDFs, etc.

  • toapi

    7.4 0.0 Python
    Every web site provides APIs

  • sumy

    7.2 6.7 L5 Python
    A module for automatic summarization of text documents and HTML pages.

  • python-readability

    6.9 6.3 HTML
    Fast Python port of arc90's readability tool.

  • gain

    6.7 0.0 Python
    Web crawling framework based on asyncio.

  • PSpider

    6.6 6.8 Python
    A simple web spider frame written by Python, which needs Python3.5+

  • html2text

    6.2 5.7 L1 Python
    Convert HTML to Markdown-formatted text.

  • Sukhoi

    4.6 0.0 Python
    Minimalist and powerful Web Crawler.

  • micawber

    3.8 2.8 L5 Python
    A small library for extracting rich content from URLs.

  • lassie

    3.7 1.2 L4 Python
    Web Content Retrieval for Humans.

  • Goose3

    3.1 4.6 HTML
    A Python 3 compatible version of goose

  • spidy Web Crawler

    3.0 0.8 Python
    The simple, easy to use command line web crawler.

  • selectolax

    2.9 4.8 Python
    Python bindings to Modest engine (very fast HTML5 parser with CSS selectors).

  • opengraph

    2.9 0.0 L5 Python
    A Python module to parse the Open Graph Protocol

  • brownant

    2.7 0.0 Python
    Brownant is a web data extracting framework.

  • Haul

    2.5 0.0 L5 Python
    An Extensible Image Crawler.

  • sanitize

    1.6 0.0 L4 Python
    Bringing sanity to world of messed-up data.

  • JSONPATH

    0.7 8.4 Python
    A selector expression for extracting data from JSON.

  • Data Extractor

    0.7 7.7 Python
    Combine XPath, CSS Selectors and JSONPath for Web data extracting.

  • htmldate

    - -
    Fast and robust extraction of original and updated publication dates from web pages

  • TWINT

    - -
    An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.