micawber alternatives and similar packages

Based on the "Web Content Extracting" category.
Alternatively, view micawber alternatives based on common mentions on social networks and blogs.

TWINT

9.4 0.0 micawber VS TWINT

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
newspaper

9.3 0.0 L3 micawber VS newspaper

newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:

WorkOS - The modern identity platform for B2B SaaS

The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

Promo workos.com

python-goose

7.9 0.0 micawber VS python-goose

Html Content / Article Extractor, web scrapping lib in Python
textract

7.6 3.7 micawber VS textract

extract text from any document. no muss. no fuss.
sumy

7.4 6.7 L5 micawber VS sumy

Module for automatic summarization of text documents and HTML pages.
toapi

7.1 0.0 micawber VS toapi

Every web site provides APIs.
python-readability

6.7 3.4 micawber VS python-readability

fast python port of arc90's readability tool, updated to match latest readability.js!
trafilatura

6.5 8.4 micawber VS trafilatura

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments
html2text

5.7 6.3 L1 micawber VS html2text

Convert HTML to Markdown-formatted text.
Goose3

4.2 6.6 micawber VS Goose3

A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
lassie

3.7 0.0 L4 micawber VS lassie

Web Content Retrieval for Humans™
opengraph

3.0 0.0 L5 micawber VS opengraph

A python module to parse the Open Graph Protocol
inscriptis -- HTML to text conversion library, command line client and Web service

2.6 8.5 micawber VS inscriptis -- HTML to text conversion library, command line client and Web service

A python based HTML to text conversion library, command line client and Web service.
Haul

2.5 0.0 L5 micawber VS Haul

An Extensible Image Crawler
htmldate

2.0 7.6 micawber VS htmldate

Fast and robust date extraction from web pages, with Python or on the command-line
sanitize

1.5 0.0 L4 micawber VS sanitize

Bringing sanity to world of messed-up data
JSONPATH

1.0 5.7 micawber VS JSONPATH

A query expression for extracting data from JSON.
Data Extractor

0.9 6.0 micawber VS Data Extractor

Combine XPath, CSS Selectors and JSONPath for Web data extracting.