Pipeline Management packages

Showing projects tagged as Pipeline and Pipeline Management

  • Airflow

    9.8 10.0 Python
    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  • celery

    9.6 9.5 L3 Python
    Distributed Task Queue (development branch)
  • luigi

    9.5 7.5 L3 Python
    Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
  • Pinball

    5.2 0.1 Python
    Pinball is a scalable workflow manager
  • pipelines

    2.9 0.0 Nim
    An experimental programming language for data flow