Airflow v2020.11.23 Release Notes

Release Date: 2020-11-18 // 11 months ago

Previous changes from v1.10.12

  • ๐Ÿ†• New Features

    • โž• Add DateTimeSensor (#9697)
    • โž• Add ClusterPolicyViolation support to airflow local settings (#10282)
    • Get Airflow configs with sensitive data from Secret Backends (#9645)
    • [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625)
    • ๐Ÿ‘ Allow defining custom XCom class (#8560)

    ๐Ÿ› Bug Fixes

    • โž• Add pre 1.10.11 Kubernetes Paths back with Deprecation Warning (#10067)
    • ๐Ÿ›  Fixes PodMutationHook for backwards compatibility (#9903)
    • ๐Ÿ›  Fix bug in executor_config when defining resources (#9935)
    • ๐Ÿ”€ Respect DAG Serialization setting when running sync_perm (#10321)
    • ๐Ÿ‘‰ Show correct duration on graph view for running task (#8311) (#8675)
    • ๐Ÿ›  Fix regression in SQLThresholdCheckOperator (#9312)
    • ๐Ÿ›  [AIRFLOW-6931] Fixed migrations to find all dependencies for MSSQL (#9891)
    • Avoid sharing session with RenderedTaskInstanceFields write and delete (#9993)
    • ๐Ÿ›  Fix clear future recursive when ExternalTaskMarker is used (#9515)
    • ๐Ÿ– Handle IntegrityError while creating TIs (#10136)
    • ๐Ÿ›  Fix airflow-webserver startup errors when using Kerberos Auth (#10047)
    • ๐Ÿ›  Fixes treatment of open slots in scheduler (#9316) (#9505)
    • ๐Ÿ›  Fix KubernetesPodOperator reattachment (#10230)
    • ๐Ÿ›  Fix more PodMutationHook issues for backwards compatibility (#10084)
    • [AIRFLOW-5391] Do not re-run skipped tasks when they are cleared (#7276)
    • Fix task_instance_mutation_hook (#9910)
    • ๐Ÿ›  Fixes failing formatting of DAG file containing {} in docstring (#9779)
    • Fix is_terminal_support_colors function (#9734)
    • ๐Ÿ›  Fix PythonVirtualenvOperator when using provide_context=True (#8256)
    • ๐Ÿ›  Fix issue with mounting volumes from secrets (#10366)
    • ๐Ÿ›  BugFix: K8s Executor Multinamespace mode is evaluated to true by default (#10410)
    • ๐Ÿ‘‰ Make KubernetesExecutor recognize kubernetes_labels (#10412)
    • ๐Ÿ›  Fix broken Kubernetes PodRuntimeInfoEnv (#10478)

    ๐Ÿ‘Œ Improvements

    • ๐Ÿ‘‰ Use Hash of Serialized DAG to determine DAG is changed or not (#10227)
    • โšก๏ธ Update Serialized DAGs in Webserver when DAGs are Updated (#9851)
    • โšก๏ธ Do not Update Serialized DAGs in DB if DAG did not change (#9850)
    • Add repr to SerializedDagModel (#9862)
    • โšก๏ธ Update JS packages to latest versions (#9811) (#9921)
    • ๐Ÿ’ป UI Graph View: Focus upstream / downstream task dependencies on mouseover (#9303)
    • ๐Ÿ‘ Allow image in KubernetesPodOperator to be templated (#10068)
    • [AIRFLOW-6843] Add delete_option_kwargs to delete_namespaced_pod (#7523)
    • ๐Ÿ‘Œ Improve process terminating in scheduler_job (#8064)
    • Replace deprecated base classes used in bigquery_check_operator (#10272)
    • [AIRFLOW-5897] Allow setting -1 as pool slots value in webserver (#6550)
    • Limit all google-cloud api to <2.0.0 (#10317)
    • [AIRFLOW-6706] Lazy load operator extra links (#7327) (#10318)
    • โž• Add Snowflake support to SQL operator and sensor (#9843)
    • ๐Ÿ‘‰ Makes multi-namespace mode optional (#9570)
    • ๐Ÿ“Œ Pin Pyarrow < 1.0
    • ๐Ÿ“Œ Pin pymongo version to <3.11.0
    • ๐Ÿ“Œ Pin google-cloud-container to <2 (#9901)
    • ๐Ÿ”’ Dockerfile: Remove package.json and yarn.lock from the prod image (#9814)
    • ๐Ÿณ Dockerfile: The group of embedded DAGs should be root to be OpenShift compatible (#9794)
    • โšก๏ธ Update upper limit of flask-swagger, gunicorn & jinja2 (#9684)
    • Webserver: Sanitize values passed to origin param (#10334)
    • Sort connection type list in add/edit page alphabetically (#8692)

    Doc only changes

    • โž• Add new committers: Ry Walker & Leah Cole to project.rst (#9892)
    • โž• Add Qingping Hou to committers list (#9725)
    • ๐Ÿ“š Updated link to official documentation (#9629)
    • Create a short-link for Airflow Slack Invites (#10034)
    • ๐Ÿ›  Fix docstrings in BigQueryGetDataOperator (#10042)
    • ๐Ÿ“„ Set language on code-block on docs/howto/email-config.rst (#10238)
    • โœ‚ Remove duplicate line from 1.10.10 CHANGELOG (#10289)
    • ๐Ÿ‘Œ Improve heading on Email Configuration page (#10175)
    • ๐Ÿ›  Fix link for the Jinja Project in docs/tutorial.rst (#10245)
    • Create separate section for Cron Presets (#10247)
    • โž• Add Syntax Highlights to code-blocks in docs/best-practices.rst (#10258)
    • ๐Ÿ›  Fix docstrings in BigQueryGetDataOperator (#10042)
    • ๐Ÿ›  Fix typo in Task Lifecycle section (#9867)
    • ๐Ÿ“„ Make Secret Backend docs clearer about Variable & Connection View (#8913)