Popularity
7.4
Growing
Activity
6.1
Stable
15
104
613

Description

An interactive parallelization framework which is especially useful in configuring data science workload distribution. Eg. supports openMIP, MPI runs on High Performance Clusters

Code Quality Rank: L3
Programming language: Python
License: BSD 3-clause "New" or "Revised" License
Latest version: v6.2.4

Interactive Parallel Computing with IPython alternatives and similar packages

Based on the "Science and Data Analysis" category

Do you think we are missing an alternative of Interactive Parallel Computing with IPython or a related project?

Add another 'Science and Data Analysis' Package

README

Interactive Parallel Computing with IPython

ipyparallel is the new home of IPython.parallel. ipyparallel is a Python package and collection of CLI scripts for controlling clusters for Jupyter.

ipyparallel contains the following CLI scripts:

  • ipcluster - start/stop a cluster
  • ipcontroller - start a scheduler
  • ipengine - start an engine

Install

Install ipyparallel:

pip install ipyparallel

To enable the IPython Clusters tab in Jupyter Notebook:

ipcluster nbextension enable

To disable it again:

ipcluster nbextension disable

See the documentation on configuring the notebook server to find your config or setup your initial jupyter_notebook_config.py.

JupyterHub Install

To install for all users on JupyterHub, as root:

jupyter nbextension install --sys-prefix --py ipyparallel
jupyter nbextension enable --sys-prefix --py ipyparallel
jupyter serverextension enable --sys-prefix --py ipyparallel

Run

Start a cluster:

ipcluster start

Use it from Python:

import os
import ipyparallel as ipp

rc = ipp.Client()
ar = rc[:].apply_async(os.getpid)
pid_map = ar.get_dict()

See the docs for more info.