Popularity
0.5
Stable
Activity
3.2
Declining
4
1
0

Description

If you're using Dask with tasks that use a lot of memory, RAM is your bottleneck for parallelism. That means you want to know how much memory each task uses:

1. So you can set the highest parallelism level (process or threads) for each machine, given available to RAM. 2. In order to know where to focus memory optimization efforts.

dask-memusage is an MIT-licensed statistical memory profiler for Dask's Distributed scheduler that can help you with both these problems.

dask-memusage polls your processes for memory usage and records the minimum and maximum usage in a CSV.

Programming language: Python

dask-memusage alternatives and similar packages

Based on the "Science and Data Analysis" category

Do you think we are missing an alternative of dask-memusage or a related project?

Add another 'Science and Data Analysis' Package