Python MapReduce

4 MapReduce packages and projects

• PySpark

  9.9 9.9 Scala

  Apache Spark - A unified analytics engine for large-scale data processing
  

• dpark

  7.4 0.0 L3 Python

  Python clone of Spark, a MapReduce alike framework in Python
  

Collect and Analyze Billions of Data Points in Real Time

Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

Promo www.influxdata.com



• mrjob

  7.1 0.0 L2 Python

  Run MapReduce jobs on Hadoop or Amazon Web Services
  

• dumbo

  4.9 0.0 L3 Python

  Python module that allows one to easily write and run Hadoop programs.

* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.

Updating dependencies is time-consuming. sponsored blog.mergify.com

Popular Comparisons

• PySpark
  vs
  mrjob
• mrjob
  vs
  luigi
• dpark
  vs
  PySpark
• mrjob
  vs
  dumbo

Write Clean Python Code. Always. sponsored www.sonarsource.com