Pipeline packages

Showing projects tagged as Pipeline

  • Airflow

    9.8 10.0 Python
    Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
  • celery

    9.6 9.4 L3 Python
    Distributed Task Queue (development branch)
  • luigi

    9.5 6.8 L3 Python
    Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
  • Pinball

    5.2 0.1 Python
    Pinball is a scalable workflow manager
  • pdpipe

    3.8 7.3 Python
    Easy pipelines for pandas DataFrames.
  • pipelines

    2.9 0.0 Nim
    An experimental programming language for data flow
  • pypyr automation task runner

    2.7 7.7 Python
    pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.
  • spline

    1.1 2.9 Python
    Spline is a tool that is capable of running locally as well as part of well known pipelines like Jenkins (Jenkinsfile), Travis CI (.travis.yml) or similar ones.