All Versions
10
Latest Version
Avg Release Cycle
97 days
Latest Release
2458 days ago
Changelog History
Changelog History
-
v0.5.0 Changes
July 27, 2018API change
- โ Remove module-level api like
dpark.textFile
. - ๐ Support Streaming shuffle and Disk shuffle (Experimental, compatible).
๐ Fixes
- ๐ Bug when parsing mfs chunk info.
๐ Improvement
- ๐ Better broadcast impl using shared memory for tasks on the same slave to reduce memory cost.
- ๐ Better offer-matching logic for MesosScheduler which remember bad slaves.
- ๐ Refactor: style and layout.
๐ New Feature
- Multi segment dump to save memory.
- Gather statics for stage.
- ๐ Support run tests/test_rdd on mesos.
- โ Add colorful progress bar for dpark.
- ๐ Support mesos role.
- ๐ Support multi named mesos master in conf.
- Loghub for admin.
- โ Remove module-level api like
-
v0.4.2 Changes
March 19, 2018- ๐ Support Python3 & PyPy
- ๐ Support MooseFS 3.x & refactor on file-system interface
-
v0.4.1 Changes
March 09, 2017- โจ Enhancement for the containerizer in DPark
- ๐ Use broadcast when parallelize big dataset
- ๐ Fix missing line bug for bzip2 files
- โ Add TopByKey in RDD
- Other minor bugs
-
v0.4.0 Changes
December 06, 2016- ๐ Bugfix: deserialize error of old-style class.
- ๐จ Refactor beansdb RDD
- ๐ป Web UI support for dpark
- ๐ Use pymesos >= 0.2.0
- Eager serialize values of ParallelCollection
-
v0.3.5
October 27, 2016 -
v0.3.3
September 20, 2016 -
v0.3.2
June 07, 2016 -
v0.3.1
May 25, 2016 -
v0.2.9
March 15, 2016 -
v0.2.8
March 04, 2016