All Versions
10
Latest Version
Avg Release Cycle
97 days
Latest Release
1177 days ago

Changelog History

  • v0.5.0 Changes

    July 27, 2018

    API change

    • โœ‚ Remove module-level api like dpark.textFile.
    • ๐Ÿ‘Œ Support Streaming shuffle and Disk shuffle (Experimental, compatible).

    ๐Ÿ›  Fixes

    • ๐Ÿ› Bug when parsing mfs chunk info.

    ๐Ÿ‘Œ Improvement

    • ๐Ÿ‘ Better broadcast impl using shared memory for tasks on the same slave to reduce memory cost.
    • ๐Ÿ‘ Better offer-matching logic for MesosScheduler which remember bad slaves.
    • ๐Ÿ’… Refactor: style and layout.

    ๐Ÿ†• New Feature

    • Multi segment dump to save memory.
    • Gather statics for stage.
    • ๐Ÿ‘Œ Support run tests/test_rdd on mesos.
    • โž• Add colorful progress bar for dpark.
    • ๐Ÿ‘Œ Support mesos role.
    • ๐Ÿ‘Œ Support multi named mesos master in conf.
    • Loghub for admin.
  • v0.4.2 Changes

    March 19, 2018
    • ๐Ÿ‘Œ Support Python3 & PyPy
    • ๐Ÿ‘Œ Support MooseFS 3.x & refactor on file-system interface
  • v0.4.1 Changes

    March 09, 2017
    • โœจ Enhancement for the containerizer in DPark
    • ๐Ÿ‘‰ Use broadcast when parallelize big dataset
    • ๐Ÿ›  Fix missing line bug for bzip2 files
    • โž• Add TopByKey in RDD
    • Other minor bugs
  • v0.4.0 Changes

    December 06, 2016
    • ๐Ÿ›  Bugfix: deserialize error of old-style class.
    • โ™ป๏ธ Refactor beansdb RDD
    • ๐Ÿ’ป Web UI support for dpark
    • ๐Ÿ‘‰ Use pymesos >= 0.2.0
    • Eager serialize values of ParallelCollection
  • v0.3.5

    October 27, 2016
  • v0.3.3

    September 20, 2016
  • v0.3.2

    June 07, 2016
  • v0.3.1

    May 25, 2016
  • v0.2.9

    March 15, 2016
  • v0.2.8

    March 04, 2016