luigi changelog

Changelog History

Page 1

• v3.0.2 Changes

  September 23, 2020

  3.0.2

  🛠 Fixed:

  luigi

  • 👷 Garbage collect task result queue when worker context exits #2973
  • 🛠 Fixing problem with ListParameter and Dynamic Dependencies #2970

  🔄 Changed:

  luigi

  • ⬇️ Drop Python 3.3 and 3.4 support #2978

  luigi.contrib

  • ⚡️ Use updated uri for gcs batch reqs #2998

• v3.0.1 Changes

  July 23, 2020

  ➕ Added:

  luigi

  • 👷 Worker_timeout can be 0. #2968
  • 👷 Return bq job id from biquery.run_job() #2957
  • Documentation for check_complete_on_run config #2961

• v3.0.0 Changes

  June 02, 2020

  3.0.0

  🗄 This is a major release without many feature changes compared to 2.8.13. The reason we decided to give it a major bump is the drop of Python2 support. From this version on, Luigi stops supporting Python2 for the obvious reason. 3.0.0 release includes a series of PRs deprecating Python2 , plus a few other changes listed below. Special thanks go to @drowoseque for doing all the great work!

  ➕ Added:

  luigi

  • 👷 Show task progress in visualizer workers tab. #2932

  🛠 Fixed:

  luigi

  • 🛠 Fix TravisCI build #2948
  • 👉 Use is_alive in favour of isAlive for Python 3.9 compatibility. #2940

• v3.0.0.b2 Changes

  February 10, 2020

  🗄 This the second 3.0.0 beta release including a series of PRs deprecating Python2 , plus following:

  Special thanks go to @drowoseque for doing all the great work!

  ➕ Added:

  luigi

  • ➕ Add internal version info #2760
  • 🆕 EnumListParameter #2801 ( new since 3.0.0b1 )

  luigi.contrib

  • [luigi.contrib.spark] pyspark python options added #2818

  🛠 Fixed:

  luigi

  • 🛠 Fix params hashing #2540
  • Check for autoload_range istead of autoload-range
  • autoload_range doc fix #2878 ( new since 3.0.0b1 )

  ✂ Removed:

  luigi

  • 🚚 [luigi.file] removed #2832
  • 🚚 [luigi.mock.MockFile] removed #2839

  🔄 Changed:

  luigi

  • 👍 Allow python-daemon >= 2.2.0 if not on windows #2796
  • ⏱ Make URLLibFetcher aware of basic auth info in scheduler URL. #2791

  luigi.contrib

  • 🔊 [luigi.contrib.external_program.ExternalProgramTask] logs_output_pattern_to_url provided #2822
  • 🆕 [luigi.contrib.hive] HiveTableTarget inherits HivePartitionTarget #2872 ( new since 3.0.0b1 )
  • ⚙ [luigi.contrib.pyspark_runner] SparkSession support in PySparkTask #2862 ( new since 3.0.0b1 )

• v3.0.0.b1 Changes

  December 30, 2019

  🗄 This the first 3.0.0 beta release including a series of PRs deprecating Python2 , plus following:

  Special thanks go to @drowoseque for doing all the great work!

  ➕ Added:

  luigi

  • ➕ Add internal version info #2760

  luigi.contrib

  • [luigi.contrib.spark] pyspark python options added #2818

  🛠 Fixed:

  luigi

  • 🛠 Fix params hashing #2540
  • Check for autoload_range istead of autoload-range

  ✂ Removed:

  luigi

  • 🚚 [luigi.file] removed #2832
  • 🚚 [luigi.mock.MockFile] removed #2839

  🔄 Changed:

  luigi

  • 👍 Allow python-daemon >= 2.2.0 if not on windows #2796
  • ⏱ Make URLLibFetcher aware of basic auth info in scheduler URL. #2791

  luigi.contrib

  • 🔊 [luigi.contrib.external_program.ExternalProgramTask] logs_output_pattern_to_url provided #2822

• v2.8.13 Changes

  April 29, 2020

  ➕ Added:

  luigi.contrib

  • 👍 Presto support in Luigi (#2885)

  🛠 Fixed:

  luigi

  • removed wrong type of Target. init path arg from doc master (#2927)
  • ✂ remove StreamingBodyAdaptor that didn't allow choosing the chunk size (#2929)
  • 🛠 Fix docs explaining write modes for Luigi Targets. Closes #2783 (#2931)
  • 🔧 All configuration parameters in docs now use underscore in their names for consistency. (#2890)

  🔄 Changed:

  luigi

  • 👍 Allowed wider popovers in grapth. (#2093)
  • 📚 update documentation to prefer pykube-ng (#2924)

• v2.8.12 Changes

  February 19, 2020

  ➕ Added:

  luigi

  • EnumListParameter #2801

  🛠 Fixed:

  luigi

  • Import ABC from collections.abc instead of collections for Python 3.9 compatibility #2895

  🔄 Changed:

  luigi.contrib

  • [luigi.contrib.hive] HiveTableTarget inherits HivePartitionTarget #2872
  • 👍 [luigi.contrib.pyspark_runner] SparkSession support in PySparkTask #2862

• v2.8.11 Changes

  January 02, 2020

  ➕ Added:

  luigi

  • ➕ Add internal version info #2760

  luigi.contrib

  • [luigi.contrib.spark] pyspark python options added #2818

  🛠 Fixed:

  luigi

  • 🛠 Fix params hashing #2540
  • Check for autoload_range istead of autoload-range
  • autoload_range doc fix #2878

  ✂ Removed:

  luigi

  • 🚚 [luigi.file] removed #2832
  • 🚚 [luigi.mock.MockFile] removed #2839

  🔄 Changed:

  luigi

  • 👍 Allow python-daemon >= 2.2.0 if not on windows #2796
  • ⏱ Make URLLibFetcher aware of basic auth info in scheduler URL. #2791

  luigi.contrib

  • 🔊 [luigi.contrib.external_program.ExternalProgramTask] logs_output_pattern_to_url provided #2822

• v2.8.10 Changes

  November 22, 2019

  ➕ Added:

  luigi

  • ➕ Add HEAD endpoint to scheduler server for status/health checks #2789

  luigi.contrib

  • [luigi.contrib.hive] WarehouseHiveClient #2826

  🛠 Fixed:

  luigi.contrib

  • Add Python version-agnostic get_writer_schema. #2827
  • PySparkTask: handle special characters in name (#2778) #2779

  🔄 Changed:

  luigi.contrib

  • [luigi.contrib.spark] tracking_url_pattern as a property #2820
  • Add pod_creation_wait_interal #2813
  • Added optional argument 'aws_session_token' to S3Client #2798

• v2.8.9 Changes

  August 27, 2019

  ➕ Added:

  luigi

  • ➕ Adds "Force Commit" button in UI to set tasks to DONE #2751
  • 👉 Show task history link in visualizer when recording. #2759

  🛠 Fixed:

  luigi

  • 📚 Replace documentation reference to outdated test environment py27-nonhdfs #2762
  • Issue 2644: Tasks can be run several times under certain conditions #2645

  luigi & luigi.contrib

  • ✅ Ensure ignored tests are picked up by tox #2758

  🔄 Changed:

  luigi

  • ⚡️ Update tornado requirement for new enough python versions #2761

  luigi.contrib

  • contrib/ftp: Clean up temporary files #2755

• 1
• 2
• 3
• Next ›
• Last »