Popularity

7.7

Stable

Activity

4.6

Stars 4,765

Watchers 109

Forks 382

Last Commit 13 days ago

Description

A Python library for automating interaction with websites. MechanicalSoup automatically stores and sends cookies, follows redirects, and can follow links and submit forms. It doesn't do Javascript.

I was a fond user of the Mechanize library, but unfortunately it's incompatible with Python 3 and development is inactive. MechanicalSoup provides a similar API, built on Python giants Requests (for http sessions) and BeautifulSoup (for document navigation).

Code Quality Rank: L4

Programming language: Python

License: MIT License

Tags: Web Crawling

Latest version: v0.12.0

MechanicalSoup alternatives and similar packages

Based on the "Web Crawling" category.
Alternatively, view MechanicalSoup alternatives based on common mentions on social networks and blogs.

Scrapy

9.9 9.6 L4 MechanicalSoup VS Scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.
pyspider

9.5 0.0 L3 MechanicalSoup VS pyspider

DISCONTINUED. A Powerful Spider(Web Crawler) System in Python.

InfluxDB – Built for High-Performance Time Series Workloads

InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

Promo www.influxdata.com

requests-html

9.1 0.0 MechanicalSoup VS requests-html

Pythonic HTML Parsing for Humans™
portia

8.9 0.0 L2 MechanicalSoup VS portia

Visual scraping for Scrapy
RoboBrowser

7.2 0.0 L4 MechanicalSoup VS RoboBrowser

A simple, Pythonic library for browsing the web without a standalone web browser.
PSpider

6.4 0.0 MechanicalSoup VS PSpider

简单易用的Python爬虫框架，QQ交流群：597510560
cola

6.4 0.0 L3 MechanicalSoup VS cola

A high-level distributed crawling framework.
Grab

6.4 3.0 L3 MechanicalSoup VS Grab

Web Scraping Framework
feedparser

6.3 7.5 L3 MechanicalSoup VS feedparser

Parse feeds in Python
Scrapely

6.1 0.0 MechanicalSoup VS Scrapely

A pure-python HTML screen-scraping library
gain

6.0 0.0 MechanicalSoup VS gain

Web crawling framework based on asyncio.
Sukhoi

4.2 0.0 MechanicalSoup VS Sukhoi

Minimalist and powerful Web Crawler.
Google Search Results in Python

4.1 5.0 MechanicalSoup VS Google Search Results in Python

Google Search Results via SERP API pip Python Package
MSpider

4.0 0.0 MechanicalSoup VS MSpider

Spider
reader

3.4 9.1 MechanicalSoup VS reader

A Python feed reader library.
spidy Web Crawler

3.3 0.0 MechanicalSoup VS spidy Web Crawler

The simple, easy to use command line web crawler.
Crawley

2.7 0.0 MechanicalSoup VS Crawley

Pythonic Crawling / Scraping Framework based on Non Blocking I/O operations.
brownant

2.6 0.0 MechanicalSoup VS brownant

Brownant is a web data extracting framework.
Demiurge

2.1 0.0 L5 MechanicalSoup VS Demiurge

PyQuery-based scraping micro-framework.
Pomp

1.6 0.0 L5 MechanicalSoup VS Pomp

Screen scraping and web crawling framework
FastImage

1.0 0.0 L4 MechanicalSoup VS FastImage

Python library that finds the size / type of an image given its URI by fetching as little as needed
Mariner

0.4 0.0 MechanicalSoup VS Mariner

This a is mirror of Gitlab repository. Open your issues and pull requests there.