Popularity

7.7

Stable

Activity

8.4

Stable

Stars 2,866

Watchers 96

Forks 210

Last Commit 7 months ago

Description

A Python library for automating interaction with websites. MechanicalSoup automatically stores and sends cookies, follows redirects, and can follow links and submit forms. It doesn't do Javascript.

I was a fond user of the Mechanize library, but unfortunately it's incompatible with Python 3 and development is inactive. MechanicalSoup provides a similar API, built on Python giants Requests (for http sessions) and BeautifulSoup (for document navigation).

Code Quality Rank: L4

Programming language: Python

License: MIT License

Tags: Web Crawling

MechanicalSoup alternatives and related packages

Based on the "Web Crawling" category

Scrapy

9.9 9.1 L4 MechanicalSoup VS Scrapy

A fast high-level screen scraping and web crawling framework.
pyspider

9.6 6.7 L3 MechanicalSoup VS pyspider

A powerful spider system.
requests-html

9.2 5.9 MechanicalSoup VS requests-html

Pythonic HTML Parsing for Humans™
portia

9.2 2.6 L2 MechanicalSoup VS portia

Visual scraping for Scrapy.
RoboBrowser

7.9 0.0 L4 MechanicalSoup VS RoboBrowser

A simple, Pythonic library for browsing the web without a standalone web browser.
cola

7.1 0.0 L3 MechanicalSoup VS cola

A distributed crawling framework.
Grab

6.7 5.5 L3 MechanicalSoup VS Grab

Site scraping framework.
Scrapely

6.6 0.0 MechanicalSoup VS Scrapely

A pure-python HTML screen-scraping library
gain

6.6 0.0 MechanicalSoup VS gain

Web crawling framework based on asyncio.
PSpider

6.4 6.7 MechanicalSoup VS PSpider

A simple web spider frame written by Python, which needs Python3.5+
feedparser

5.0 2.9 L3 MechanicalSoup VS feedparser

Universal feed parser.
Sukhoi

4.5 0.0 MechanicalSoup VS Sukhoi

Minimalist and powerful Web Crawler.
MSpider

4.3 0.1 MechanicalSoup VS MSpider

Spider
spidy Web Crawler

2.7 1.0 MechanicalSoup VS spidy Web Crawler

The simple, easy to use command line web crawler.
brownant

2.5 0.0 MechanicalSoup VS brownant

Brownant is a web data extracting framework.
Crawley

2.5 0.0 MechanicalSoup VS Crawley

Pythonic Crawling / Scraping Framework based on Non Blocking I/O operations.
Demiurge

1.9 0.0 L5 MechanicalSoup VS Demiurge

PyQuery-based scraping micro-framework.
Pomp

1.4 0.0 L5 MechanicalSoup VS Pomp

Web crawling framework inspired by and similar to Scrapy
FastImage

0.9 0.0 L4 MechanicalSoup VS FastImage

Python library that finds the size / type of an image given its URI by fetching as little as needed
Mariner

0.6 7.6 MechanicalSoup VS Mariner

Command line torrent searcher.

* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest. Visit our partner's website for more details.

Do you think we are missing an alternative of MechanicalSoup or a related project?

Add another 'Web Crawling' Package

MechanicalSoup Recommendations

There are no recommendations yet. Be the first to promote MechanicalSoup!

Have you used MechanicalSoup? Share your experience. Write a short recommendation and MechanicalSoup, you and your project will be promoted on Awesome Python.
Recommend MechanicalSoup