Pipeline Management packages

Showing projects tagged as System and Pipeline Management

  • Airflow

    9.8 9.9 Python
    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  • celery

    9.6 9.3 L3 Python
    Distributed Task Queue (development branch)
  • luigi

    9.4 5.9 L3 Python
    Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
  • Pinball

    5.2 0.1 Python
    Pinball is a scalable workflow manager
  • rez

    5.0 0.0 Python
    An integrated package configuration, build and deployment system for software