All Versions
22
Latest Version
Avg Release Cycle
7 days
Latest Release
525 days ago

Changelog History
Page 1

  • v0.13.19 Changes

    December 08, 2020

    ๐Ÿ”„ Changelog

    0.13.19

    ๐Ÿš€ Released on December 8, 2020.

    โœจ Enhancements

    • ๐Ÿ‘ป Use explicit exception chaining - #3306
    • ๐Ÿ‘Œ Support Bitbucket as storage option - #3711
    • ๐Ÿš€ Surface pod failures and container errors in jobs deployed with the Kubernetes Agent - 3747
    • ๐Ÿ‘Œ Support timeout option in GCS tasks - #3732
    • โž• Added storage option for AWS CodeCommit - #3733
    • โž• Add the image used for a flow-run to the flow run environment as prefect.context.image - #3746
    • โž• Add UniversalRun run-config that works with all agents - #3750
    • ๐Ÿ‘Œ Support flows that have no run-config or environment - #3750
    • ๐Ÿ‘ Allow Docker storage environment vars to be used in commands - #3755
    • Add service_account_name and image_pull_secrets options to KubernetesRun and KubernetesAgent - #3778
    • โž• Add a new Client function delete_project - #3728

    Task Library

    • โž• Add task to fetch data from Dremio - #3734
    • โž• Add RunGreatExpectationsValidation task - #3753
    • โž• Add the option to post markdown artifacts from the RunGreatExpectationsValidation task - #3753

    ๐Ÿ›  Fixes

    • ๐Ÿ›  Fix state attempting to read result from absent upstream result - #3618
    • Replace deprecated download_as_string method with download_as_bytes method - #3741
    • ๐Ÿ›  Fix default image whenever working on a non-tagged commit - #3748
    • ๐Ÿ›  Fix type-casting for task timeout defaults loaded from config - #3761
    • ๐Ÿ›  Fix the ref default on GitHub storage - #3764
    • ๐Ÿ›  Fix rare cancellation bug when running with external Dask cluster - #3770

    ๐Ÿ—„ Deprecations

    • ๐Ÿ—„ Deprecated the RunGreatExpectationsCheckpoint task in favor of RunGreatExpectationsValidation - #3766

    Contributors

  • v0.13.18 Changes

    November 30, 2020

    ๐Ÿ”„ Changelog

    0.13.18

    ๐Ÿš€ Released on November 30, 2020.

    โœจ Enhancements

    • Display formatted graphql errors on client request failure - #3632
    • ๐ŸŽ Refactor Core Client API calls for performance - #3730

    Task Library

    • ๐Ÿ”จ Refactor execute query code for PostgresExecute, PostgresExecuteMany, and PostgresFetch tasks - #3714
    • ๐Ÿ›  Fix PicklingError in BigQueryLoadFile and BigQueryLoadGoogleCloudStorage - #3724
    • ๐Ÿ‘ Allow custom exporter for ExecuteNotebook task - #3725
    • Properly forward location parameter in bigquery tasks - #3726
    • ๐Ÿ‘Œ Support passing helper_script to ShellTask/DBTShellTask at runtime - #3729

    ๐Ÿ›  Fixes

    • ๐Ÿ›  Fix bug with docker storage throwing exception while trying to display output - #3717

    Contributors

  • v0.13.17 Changes

    November 24, 2020

    ๐Ÿ”„ Changelog

    0.13.17

    ๐Ÿš€ Released on November 24, 2020.

    ๐Ÿ”‹ Features

    • ๐Ÿ‘Œ Improved support for Tasks returning multiple results - #3697

    โœจ Enhancements

    • ๐Ÿ‘ Allow chaining of Task imperative dependency calls - #3696
    • Add task_definition_arn to ECSRun run-config - #3681
    • Rerun resource_manager tasks when restarting flows from failed - #3689
    • โš  Raise nice warning if user passes Task instance to Task constructor, rather than when calling the Task (or using Task.map/Task.set_dependencies) - #3691
    • Always use tenant slug in output of Client get_cloud_url function - #3692

    Task Library

    • โž• Add enhancement to StartFlowRun task to create link artifact for started flow run - #3692
    • โž• Add a new postgres task PostgresExecuteMany - #3703
    • โž• Add debug logging for Docker tasks PullImage and BuildImage - #3672
    • ShellTask returns output on failure - #3649
    • ShellTask allows streaming of output independently of the number of lines returned - #3649

    ๐Ÿ›  Fixes

    • ๐Ÿ‘‰ Make serialized_hash handle unordered task sets correctly - #3682
    • ๐Ÿ— Docker storage build error logs were not always displayed - #3693
    • ๐Ÿ›  Fix automatic quoting of Docker storage environment variable values - #3694
    • ๐Ÿ‘‰ Use exist_ok flag in os.makedirs to avoid race condition in local storage class - #3679

    Contributors

  • v0.13.16 Changes

    November 18, 2020

    ๐Ÿ”„ Changelog

    ๐Ÿš€ Released on November 17, 2020.

    โœจ Enhancements

    • ๐Ÿ‘ Experimental support for Python 3.9 - #3411

    ๐Ÿ›  Fixes

    • ๐Ÿ›  Fixes Flow.replace freezing reference tasks - #3655
    • ๐Ÿ›  Fixed bug where flow.serialized_hash() could return inconsistent values across new python instances - #3654

    Contributors

  • v0.13.15 Changes

    November 11, 2020

    ๐Ÿ”„ Changelog

    0.13.15

    ๐Ÿš€ Released on November 11, 2020.

    ๐Ÿ”‹ Features

    • โž• Add API for storing task run artifacts in the backend - #3581

    โœจ Enhancements

    • ๐Ÿ‘ Allow for setting Client headers before loading tenant when running with Prefect Server - #3515
    • Checkpoint all iterations of Looped tasks - #3619
    • โž• Add ref option to GitHub storage for specifying branches other than master - #3638
    • โž• Added ExecuteNotebook task for running Jupyter notebooks - #3599
    • โฑ Pass day_or croniter argument to CronClock and CronSchedule - #3612
    • Client.create_project and prefect create project will skip creating the project if the project already exists - #3630
    • ๐Ÿš€ Update deployments extension to AppsV1Api - #3637
    • PrefectSecret and EnvVarSecret tasks no longer require secret names be provided at flow creation time - #3641

    ๐Ÿ›  Fixes

    • ๐Ÿ›  Fix issue with retrying mapped pipelines on dask - #3519
    • โš™ Task arguments take precedence when generating task_run_name - #3605
    • ๐Ÿ›  Fix breaking change in flow registration with old server versions - #3642
    • Task arguments take precedence when generating templated targets and locations - #3627

    ๐Ÿ’ฅ Breaking Changes

    • ๐Ÿ“œ Environment variable config values now parse without requiring escaping backslashes - #3603

    Contributors

  • v0.13.14 Changes

    November 05, 2020

    ๐Ÿ”„ Changelog

    0.13.14

    ๐Ÿš€ Released on November 5, 2020.

    ๐Ÿ”‹ Features

    • flow.register accepts an idempotency key to prevent excessive flow versions from being created - #3590
    • โž• Added flow.serialized_hash() for easy generation of hash keys from the serialized flow - #3590

    โœจ Enhancements

    • โž• Add option to select cursor_type for MySQLFetch task - #3574
    • โž• Add new ECSAgent and ECSRun run config - #3585
    • ๐Ÿ‘ป Display exception information on prefect create project failure - #3589
    • 0๏ธโƒฃ prefect diagnostics no longer displays keys that have values matching the default config - #3593
    • ๐Ÿ‘ Allow use of multiple image pull secrets in KubernetesAgent, DaskKubernetesEnvironment - #3596
    • โž• Added FROM to explicitly chain exceptions in src/prefect/tasks/twitter - #3602
    • โž• Add UTC offset to default logging.datefmt; logging timestamp converter now follows Python default behavior - #3607
    • ๐Ÿ‘Œ Improve error message when API responds with 400 status code - #3615

    ๐Ÿ—„ Deprecations

    • ๐Ÿ—„ Deprecate prefect agent start <kind> in favor of prefect agent <kind> start - #3610
    • ๐Ÿ—„ Deprecate prefect agent install <kind> in favor of prefect agent <kind> install - #3610

    Contributors

  • v0.13.13 Changes

    October 27, 2020

    ๐Ÿ”„ Changelog

    0.13.13

    ๐Ÿš€ Released on October 27, 2020.

    โœจ Enhancements

    • Don't stop execution if the task runner fails to load a cached result - #3378
    • โž• Add option to specify networkMode for tasks created by the Fargate Agent - #3546
    • ๐Ÿ‘ Allows to schedule flow runs at an arbitrary time with StartFlowRun - #3573

    ๐Ÿ›  Fixes

    • ๐Ÿ‘‰ Use BlobServiceClient instead of BlockBlobService to connect to azure blob in azure tasks - #3562
    • Tasks with log_stdout=True work with non-utf8 output - #3563

    Contributors

  • v0.13.12 Changes

    October 20, 2020

    ๐Ÿ”„ Changelog

    0.13.12

    ๐Ÿš€ Released on October 20, 2020.

    โœจ Enhancements

    • โฑ Agents now submit flow runs in order of scheduled start times - #3165
    • ๐Ÿš€ Updating k8s tutorial docs to include instructions on how to provide access to S3 from kubernetes deployments on AWS - #3200
    • โž• Adds option to specify default values for GetItem and GetAttr tasks - #3489
    • ๐Ÿ‘ Allow disabling default storage labels for the LocalAgent - #3503
    • ๐Ÿ‘Œ Improve overall functionality of docs search, full list of changes here - #3504
    • โž• Add LocalRun implementation for run_config based flows - #3527
    • โž• Add DockerRun implementation for run_config based flows - #3537
    • โฑ Raise a better error message when trying to register a flow with a schedule using custom filter functions - #3450
    • โš™ RenameFlowRunTask: use default flow_run_id value from context - #3548
    • 0๏ธโƒฃ Raise a better error message when trying to register a flow with parameters with JSON-incompatible defaults - #3549

    Task Library

    • Extended GCSUpload task to allow uploading of bytes/gzip data - #3507
    • Allow setting runtime webook_secret on SlackTask and kwarg for webhook_secret retrieved from PrefectSecret task - #3522

    ๐Ÿ›  Fixes

    • ๐Ÿ›  Fix get flow-runs and describe flow-runs CLI commands querying of removed duration field - #3517
    • ๐Ÿ›  Fix multiprocess based timeout handler on linux - #3526
    • ๐Ÿ›  Fix API doc generation incorrectly compiling mocked imports - #3504
    • ๐Ÿ›  Fix multiprocessing scheduler failure while running tasks with timeouts - #3511
    • โšก๏ธ Update Fargate task definition validation - #3514
    • ๐Ÿ›  Fix bug in k8s where the resource-manager would sometimes silently crash on errors - #3521
    • โž• Add labels from flow.storage for run_config based flows - #3527
    • ๐Ÿ›  Fix LocalAgent PYTHONPATH construction on Windows - #3551

    ๐Ÿ—„ Deprecations

    • FlowRunTask, RenameFlowRunTask, and CancelFlowRunTask have been renamed to StartFlowRun, RenameFlowRun, and CancelFlowRun respectively - #3539

    Contributors

  • v0.13.11 Changes

    October 14, 2020

    ๐Ÿ”„ Changelog

    0.13.11

    ๐Ÿš€ Released on October 14, 2020.

    ๐Ÿ”‹ Features

    • ๐Ÿ‘ Allow for schedules that emit custom Flow Run labels - #3483

    โœจ Enhancements

    • ๐Ÿ‘ป Use explicit exception chaining - #3306
    • S3List filtering using the LastModified value - #3460
    • โž• Add Gitlab storage - #3461
    • Extend module storage capabilities - #3463
    • ๐Ÿ‘Œ Support adding additional flow labels in prefect register flow - #3465
    • 0๏ธโƒฃ Strict Type for default value of a Parameter - #3466
    • Enable automatic script upload for file-based storage when using S3 and GCS - #3482
    • Allow for passing labels to client.create_flow_run - #3483
    • ๐Ÿ’ป Display flow group ID in registration output URL instead of flow ID to avoid redirect in UI - #3500
    • โž• Add informative error log when local storage fails to load flow - #3475

    Task Library

    • โž• Add cancel flow run task - #3484
    • โž• Add new BatchSubmit task for submitting jobs to AWS batch - #3366
    • โž• Add new AWSClientWait task for waiting on long-running AWS jobs - #3366
    • โž• Add GetAttr task - #3481

    ๐Ÿ›  Fixes

    • ๐Ÿ›  Fix default profile directory creation behavior - #3037
    • ๐Ÿ›  Fix DaskKubernetesEnvironment overwriting log attributes for custom specs - #3231
    • ๐Ÿ›  Fix default behavior for dbt_kwargs in the dbt task to provide an empty string - #3280
    • ๐Ÿ›  Fix containerDefinitions environment validation - #3452
    • ๐Ÿ‘ Raise a better error when calling flow.register() from within a Flow context - #3467
    • ๐Ÿ›  Fix task cancellation on Python 3.8 to properly interrupt long blocking calls - #3474

    Contributors

  • v0.13.10 Changes

    October 06, 2020

    ๐Ÿ”„ Changelog

    0.13.10

    ๐Ÿš€ Released on October 6, 2020.

    โœจ Enhancements

    • โž• Add option to template task run name at runtime when using backend API - #2100
    • Add set_task_run_name Client function - #2100
    • ๐Ÿ‘‰ Use from to explicitly chain exceptions - #3306
    • โšก๏ธ Update error message when registering flow to non-existant project - #3418
    • Add flow.run_config, an experimental design for configuring deployed flows - #3333
    • ๐Ÿ‘ Allow python path in Local storage - #3351
    • Enable agent registration for server users - #3385

    Task Library

    • โž• Add keypair auth for snowflake - #3404
    • โž• Add new RenameFlowRunTask for renaming a currently running flow - #3285.

    ๐Ÿ›  Fixes

    • ๐Ÿ›  Fix mypy typing for target kwarg on base Task class - #2100
    • ๐Ÿ›  Fix Fargate Agent not parsing cpu and memory provided as integers - #3423
    • ๐Ÿ›  Fix MySQL Tasks breaking on opening a context - #3426

    Contributors