Pipeline Management packages

Showing projects tagged as System and Pipeline Management

  • Airflow

    9.8 10.0 Python
    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  • celery

    9.6 9.6 L3 Python
    Distributed Task Queue (development branch)
  • luigi

    9.5 8.2 L3 Python
    Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
  • Pinball

    5.2 0.1 Python
    Pinball is a scalable workflow manager
  • rez

    5.0 9.1 Python
    An integrated package configuration, build and deployment system for software