Distributed Computing packages

Showing projects tagged as Distributed Computing

  • Ray

    9.8 10.0 Python
    Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
  • gRPC

    9.8 9.9 L3 C++
    The C based gRPC (C++, Python, Ruby, Objective-C, PHP, C#)
  • celery

    9.6 9.6 L3 Python
    Distributed Task Queue (development branch)
  • PaddlePaddle

    9.6 10.0 L1 C++
    PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice (『飞桨』核心框架,深度学习&机器学习高性能单机、分布式训练和跨平台部署)
  • zipline

    9.5 0.0 L3 Python
    Zipline, a Pythonic Algorithmic Trading Library
  • Dask

    9.2 9.7 L2 Python
    Parallel computing with task scheduling
  • rq

    8.9 8.7 L3 Python
    Simple job queues for Python
  • Faust

    8.2 1.4 Python
    Python Stream Processing
  • dramatiq

    7.6 7.5 Python
    A fast and reliable background task processing library for Python 3.
  • kombu

    7.5 8.9 Python
    Messaging library for Python.
  • AutobahnPython

    7.1 5.0 L2 Python
    WebSocket and WAMP in Python for Twisted and asyncio
  • mrjob

    6.9 0.0 L2 Python
    Run MapReduce jobs on Hadoop or Amazon Web Services
  • pulsar

    6.3 0.0 L3 Python
    DISCONTINUED. Event-driven concurrent framework for Python.
  • Crossbar

    6.2 3.2 L2 Python
    Crossbar.io - WAMP application router
  • RPyC

    5.7 7.3 Python
    RPyC (Remote Python Call) - A transparent and symmetric RPC library for python
  • Pinball

    5.2 0.1 Python
    DISCONTINUED. Pinball is a scalable workflow manager
  • Streamz

    5.0 4.0 Python
    Real-time stream processing for python
  • SCOOP (Scalable COncurrent Operations in Python)

    4.1 0.0 Python
    SCOOP (Scalable COncurrent Operations in Python)
  • KQ

    3.5 0.0 L4 Python
    Kafka-based Job Queue for Python
  • Frugal

    3.0 9.3 Go
    DISCONTINUED. Thrift improved
  • hot-redis

    2.9 0.0 L4 Python
    Rich Python data types for Redis
  • rele

    2.7 4.6 Python
    Easy to use Google Pub/Sub
  • Thespian Actor Library

    2.6 8.0 Python
    Python Actor concurrency library
  • qbatch

    1.3 0.0 L5 Python
    python program for serial farming jobs on compute clusters
  • dask-memusage

    0.9 0.0 Python
    A low-impact profiler to figure out how much memory each task in Dask is using
  • drover

    0.5 0.0 Python
    Drover is a command-line utility for deploying Python packages to Lambda functions.