luigi v2.8.4 Release Notes

Release Date: 2019-05-06 // almost 5 years ago
  • ๐Ÿš€ This release is broken due to #2628 .

    โž• Added:

    luigi
    • โž• Added support for a detailed LuigiRunResult instead of a plain Boolean (#2630)
    • Add worker option 'max_keep_alive_idle_duration (#2654)
    • โž• Added worker-id commandline parameter (#2655)
    luigi.contrib
    • โž• Add support for specifying kubernetes namespace (#2629)
    • โž• Add a Task wrapper for MicroSoft OpenPAI (#2531)
    • Provide automatic URL tracking for Spark applications (#2661) (#2669)
    • add beam_dataflow_task to luigi/contrib (#2675)
    Both
    • โž• Add Prometheus contrib for monitoring purpose (#2628)

    ๐Ÿ›  Fixed:

    luigi
    • ๐Ÿ‘ setup.py: Support older setuptools (<=20.1.1) (#2623)
    • ๐Ÿ›  Fix broken aws tests (#2658)
    • Accept pathlib based path as argument for LocalTarget (#2548)
    • ๐Ÿ›  Fix durations in D3 graph (fixes #2620) (#2624)
    • Import collections ABCs from collections.abc, not collections (#2683)
    • ๐Ÿ“š Configuration documentation: remove deprecated/wrong [core]max_reschedules entry (#2692)
    luigi.contrib
    • ๐Ÿ›  fixes #2223 HdfsTarget is not working with snakebite (#2572)
    • โž• Add port field for PostgresQuery (fixes #2625) (#2627)
    Both
    • ๐Ÿ›  Fix flake errors after moving to python 3 (#2695)

    ๐Ÿ”„ Changed:

    luigi
    • Simplify implementation of temporary_path() (#2652)
    • Prevent range-tasks from autoloading (#2656)
    • Replace Python MapReduce example with Spark example. (#2668)
    • ๐Ÿ‘ท Minor improvements to single-worker-timeout support (#2667)
    • ๐Ÿ›  Require at least python-dateutil version 2.7.5 instead of only 2.7.5 (fixes #2662) (#2679)
    • RangeMonthly should deal with whole months (#2666)
    • ๐Ÿ’… Reconcile underscore/dash config style handling (#2688) #2691
    luigi.contrib
    • โž• Add autodetect parameter to BigQueryLoadTask (#2363) (#2575)