Airflow v1.10.8 Release Notes

Release Date: 2020-02-07 // about 4 years ago
  • ๐Ÿ†• New Features

    • [AIRFLOW-4026] Add filter by DAG tags (#6489)
    • [AIRFLOW-6613] Center dag on graph view load (#7238)
    • [AIRFLOW-5843] Add conf option to Add DAG Run view (#7281)
    • [AIRFLOW-4495] Allow externally triggered dags to run for future exec dates (#7038)

    ๐Ÿ‘Œ Improvements

    • [AIRFLOW-6438] Filter DAGs returned by blocked (#7019)
    • [AIRFLOW-6666] Resolve js-yaml advisory (#7283)
    • [AIRFLOW-6632] Bump dagre-d3 to resolve lodash CVE advisory (#7280)
    • [AIRFLOW-6667] Resolve serialize-javascript advisory (#7282)
    • ๐Ÿ–จ [AIRFLOW-6451] self._print_stat() in dag_processing.py should be skippable (#7134)
    • [AIRFLOW-6495] Load DAG only once when running a task using StandardTaskRunner (#7090)
    • ๐Ÿ‘ [AIRFLOW-6319] Add support for AWS Athena workgroups (#6871)
    • ๐Ÿšš [AIRFLOW-6677] Remove deprecation warning from SQLAlchmey (#7289)
    • [AIRFLOW-6428] Fix import path for airflow.utils.dates.days_ago in Example DAGs (#7007)
    • ๐Ÿ‘ป [AIRFLOW-6595] Use TaskNotFound exception instead of AirflowException (#7210)
    • โœ… [AIRFLOW-6620] Mock celery in worker cli test (#7243)
    • ๐ŸŒฒ [AIRFLOW-6608] Change logging level for Bash & PyOperator Env exports
    • [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker (#6633)
    • ๐Ÿ“Š [AIRFLOW-6359] Make Spark status_poll_interval explicit (#6978)
    • [AIRFLOW-6359] spark_submit_hook.py status polling interval config (#6909)
    • [AIRFLOW-6316] Use exampleinclude directives in tutorial.rst (#6868)
    • ๐Ÿ”ง [AIRFLOW-6519] Make TI logs constants in Webserver configurable (#7113)
    • ๐Ÿ›ฐ [AIRFLOW-6327] http_hook: Accept json= parameter for payload (#6886)
    • [AIRFLOW-6261] flower_basic_auth eligible to _cmd (#6825)
    • [AIRFLOW-6238] Filter dags returned by dag_stats
    • [AIRFLOW-5616] Switch PrestoHook from pyhive to prestosql-client to s
    • ๐Ÿ›  [AIRFLOW-6611] Add proxy_fix configs to default_airflow.cfg (#7236)
    • โœ… [AIRFLOW-6557] Add test for newly added fields in BaseOperator (#7162)
    • ๐Ÿ“Œ [AIRFLOW-6584] Pin cassandra driver (#7194)
    • [AIRFLOW-6537] Fix backticks in rst files (#7140)
    • 0๏ธโƒฃ [AIRFLOW-4428] Error if exec_date before default_args.start_date in trigger_dag (#6948)
    • [AIRFLOW-6330] Show cli help when param blank or typo (#6883)
    • [AIRFLOW-4113] Unpin boto3 (#6884)
    • [AIRFLOW-6181] Add DebugExecutor (#6740)
    • [AIRFLOW-6504] Allow specifying configmap for Airflow Local Setting (#7097)
    • [AIRFLOW-6436] Cleanup for Airflow configs doc generator code (#7036)
    • [AIRFLOW-6436] Add x_frame_enabled config in config.yml (#7024)
    • ๐Ÿ“„ [AIRFLOW-6436] Create & Automate docs on Airflow Configs (#7015)
    • [AIRFLOW-6527] Make send_task_to_executor timeout configurable (#7143)
    • [AIRFLOW-6272] Switch from npm to yarnpkg for managing front-end dependencies (#6844)
    • ๐Ÿ”’ [AIRFLOW-6350] Security - spark submit operator logging+exceptions should mask passwords
    • ๐ŸŒฒ [AIRFLOW-6358] Log details of failed task (#6908)
    • [AIRFLOW-5149] Skip SLA checks config (#6923)
    • โšก๏ธ [AIRFLOW-6057] Update template_fields of the PythonSensor (#6656)
    • [AIRFLOW-4445] Mushroom cloud errors too verbose (#6952)
    • [AIRFLOW-6394] Simplify github PR template (#6955)
    • [AIRFLOW-5385] spark hook does not work on spark 2.3/2.4 (#6976)

    ๐Ÿ› Bug Fixes

    • [AIRFLOW-6345] Ensure arguments to ProxyFix are integers (#6901)
    • โฑ [AIRFLOW-6576] Fix scheduler crash caused by deleted task with sla misses (#7187)
    • [AIRFLOW-6686] Fix syntax error constructing list of process ids (#7298)
    • [AIRFLOW-6683] REST API respects store_serialized_dag setting (#7296)
    • [AIRFLOW-6553] Add upstream_failed in instance state filter to WebUI (#7159)
    • ๐Ÿ’ป [AIRFLOW-6357] Highlight nodes in Graph UI if task id contains dots (#6904)
    • [AIRFLOW-3349] Use None instead of False as value for encoding in StreamLogWriter (#7329)
    • [AIRFLOW-6627] Email with incorrect DAG not delivered (#7250)
    • โœ… [AIRFLOW-6637] Fix airflow test command in 1.10.x
    • ๐Ÿ–จ [AIRFLOW-6636] Avoid exceptions when printing task instance
    • ๐ŸŒฒ [AIRFLOW-6522] Clear task log file before starting to fix duplication in S3TaskHandler (#7120)
    • 0๏ธโƒฃ [AIRFLOW-5501] Make default in_cluster value in KubernetesPodOperator respect config (#6124)
    • ๐Ÿ’ป [AIRFLOW-6514] Use RUNNING_DEPS to check run from UI (#6367)
    • ๐Ÿšš [AIRFLOW-6381] Remove styling based on DAG id from DAGs page (#6985)
    • ๐Ÿณ [AIRFLOW-6434] Add return statement back to DockerOperator.execute (#7013)
    • [AIRFLOW-2516] Fix mysql deadlocks (#6988)
    • [AIRFLOW-6528] Disable flake8 W503 line break before binary operator (#7124)
    • ๐Ÿ”€ [AIRFLOW-6517] Make merge_dicts function recursive (#7111)
    • ๐Ÿ’ป [AIRFLOW-5621] Failure callback is not triggered when marked Failed on UI (#7025)
    • ๐Ÿ”’ [AIRFLOW-6353] Security - ui - add click jacking defence (#6995)
    • ๐Ÿ”’ [AIRFLOW-6348] Security - cli.py is currently printing logs with password (#6915)
    • ๐Ÿšš [AIRFLOW-6323] Remove non-ascii letters from default config (#6878)
    • [AIRFLOW-6506] Fix do_xcom_push defaulting to True in KubernetesPodOperator (#7122)
    • ๐Ÿ›  [AIRFLOW-6516] BugFix: airflow.cfg does not exist in Volume Mounts (#7109)
    • [AIRFLOW-6427] Fix broken example_qubole_operator dag (#7005)
    • ๐Ÿ›  [AIRFLOW-6385] BugFix: SlackAPIPostOperator fails when blocks not set (#7022)
    • ๐Ÿ›  [AIRFLOW-6347] BugFix: Can't get task logs when serialization is enabled (#7092)
    • โฌ‡๏ธ [AIRFLOW-XXXX] Fix downgrade of db migration 0e2a74e0fc9f (#6859)
    • [AIRFLOW-6366] Fix migrations for MS SQL Server (#6920)
    • [AIRFLOW-5406] Allow spark without kubernetes (#6921)
    • [AIRFLOW-6229] SparkSubmitOperator polls forever if status json can'tโ€ฆ (#6918)
    • ๐Ÿ”’ [AIRFLOW-6352] Security - ui - add login timeout (#6912)
    • [AIRFLOW-6397] Ensure sub_process attribute exists before trying to kill it (#6958)
    • ๐Ÿ [AIRFLOW-6400] Fix pytest not working on Windows (#6964)
    • ๐Ÿšš [AIRFLOW-6418] Remove SystemTest.skip decorator (#6991)
    • [AIRFLOW-6425] Serialization: Add missing DAG parameters to Json Schema (#7002)

    Misc/Internal

    • [AIRFLOW-6467] Use self.dag i/o creating a new one (#7067)
    • โœ… [AIRFLOW-6490] Improve time delta comparison in local task job tests (#7083)
    • โœ… [AIRFLOW-5814] Implementing Presto hook tests (#6491)
    • โœ… [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing (#6516)
    • ๐Ÿ‘• [AIRFLOW-XXXX] Move airflow-config-yaml pre-commit before pylint (#7108)
    • [AIRFLOW-XXXX] Improve clarity of confirm message (#7110)
    • [AIRFLOW-6662] install dumb init (#7300)
    • [AIRFLOW-6705] One less chatty message at breeze initialisation (#7326)
    • [AIRFLOW-6705] Less chatty integration/backend checks (#7325)
    • ๐Ÿšฆ [AIRFLOW-6662] Switch to --init docker flag for signal propagation (#7278)
    • โœ… [AIRFLOW-6661] Fail after 50 failing tests (#7277)
    • [AIRFLOW-6607] Get rid of old local scripts for Breeze (#7225)
    • โœ… [AIRFLOW-6589] BAT tests run in pre-commit on bash script changes (#7203)
    • ๐Ÿ— [AIRFLOW-6592] Doc build is moved to test phase (#7208)
    • โœ… [AIRFLOW-6641] Better diagnostics for kubernetes flaky tests (#7261)
    • โœ… [AIRFLOW-6642] Make local task job test less flaky (#7262)
    • โœ… [AIRFLOW-6643] Fix flakiness of kerberos tests
    • [AIRFLOW-6638] Remove flakiness test from test_serialized_db remove
    • [AIRFLOW-6701] Rat is downloaded from stable backup/mirrors (#7323)
    • ๐Ÿ”Š [AIRFLOW-6702] Dumping kind logs to file.io. (#7319)
    • [AIRFLOW-6491] Improve handling of Breeze parameters (#7084)
    • [AIRFLOW-6470] Avoid pipe to file when do curl (#7063)
    • โœ… [AIRFLOW-6471] Add pytest-instafail plugin (#7064)
    • ๐Ÿณ [AIRFLOW-6462] Limit exported variables in Dockerfile/Breeze (#7057)
    • [AIRFLOW-6465] Add bash autocomplete for airflow in Breeze (#7060)
    • [AIRFLOW-6464] Add cloud providers CLI tools in Breeze (#7059)
    • ๐Ÿณ [AIRFLOW-6461] Remove silent flags in Dockerfile (#7052)
    • โœ… [AIRFLOW-6459] Increase verbosity of pytest (#7049)
    • โœ… [AIRFLOW-6370] Skip Cassandra tests if cluster is not up (#6926)
    • ๐Ÿณ [AIRFLOW-6511] Remove BATS docker containers (#7103)
    • ๐Ÿšš [AIRFLOW-6475] Remove duplication of volume mount specs in Breeze.. (#7065)
    • โœ… [AIRFLOW-6489] Add BATS support for Bash unit testing (#7081)
    • ๐Ÿ–จ [AIRFLOW-6387] print details of success/skipped task (#6956)
    • [AIRFLOW-6568] Add Emacs related files to .gitignore (#7175)
    • ๐Ÿ‘ท [AIRFLOW-6575] Entropy source for CI tests is changed to unblocking (#7185)
    • โœ… [AIRFLOW-6496] Separate integrations in tests (#7091)
    • [AIRFLOW-6634] Set PYTHONPATH in interactive Breeze
    • ๐Ÿ‘ท [AIRFLOW-6564] Additional diagnostics information on CI check failure (#7172)
    • [AIRFLOW-6383] Add no trailing-whitespace pre-commit hook (#6941)

    Doc only changes

    • ๐Ÿ“š [AIRFLOW-XXXX] Consistency fixes in new documentation (#7207)
    • ๐Ÿ™‹ [AIRFLOW-XXXX] Improve grammar and structure in FAQ doc (#7291)
    • ๐Ÿ”ง [AIRFLOW-XXXX] Fix email configuration link in CONTRIBUTING.rst (#7311)
    • โšก๏ธ [AIRFLOW-XXXX] Update docs with new BranchPythonOperator behaviour (#4682)
    • โš™ [AIRFLOW-XXXX] Fix Typo in scripts/ci/ci_run_airflow_testing.sh (#7235)
    • ๐Ÿ”ง [AIRFLOW-XXXX] Screenshot showing disk space configuration for OSX (#7226)
    • ๐Ÿ“„ [AIRFLOW-XXXX] Add mentoring information to contributing docs (#7202)
    • [AIRFLOW-XXXX] Add rebase info to contributing (#7201)
    • ๐Ÿ‘ท [AIRFLOW-XXXX] Increase verbosity of static checks in CI (#7200)
    • ๐Ÿ“š [AIRFLOW-XXXX] Adds branching strategy to documentation (#7193)
    • ๐Ÿ”ง [AIRFLOW-XXXX] Move email configuration from the concept page (#7189)
    • โšก๏ธ [AIRFLOW-XXXX] Update task lifecycle diagram (#7161)
    • [AIRFLOW-XXXX] Fix reference in concepts doc (#7135)
    • ๐Ÿ“„ [AIRFLOW-XXXX] Clear debug docs (#7104)
    • โœ๏ธ [AIRFLOW-XXXX] Fix typos and broken links in development docs (#7086)
    • [AIRFLOW-XXXX] Clarify wait_for_downstream and execution_date (#6999)
    • [AIRFLOW-XXXX] Add airflow dags show command guide (#7014)
    • ๐Ÿ“š [AIRFLOW-XXXX] Update operation chaining documentation (#7018)
    • [AIRFLOW-XXXX] Add .autoenv_leave.zsh to .gitignore (#6986)
    • ๐Ÿ“ฆ [AIRFLOW-XXXX] Fix development packages installation instructions (#6942)
    • โšก๏ธ [AIRFLOW-XXXX] Update committers list (#7212)
    • โšก๏ธ [AIRFLOW-XXXX] Move UPDATING changes into correct versions (#7166)
    • ๐Ÿ“š [AIRFLOW-XXXX] Add Documentation for check_slas flag (#6974)
    • [AIRFLOW-XXXX] Fix gcp keyfile_dict typo (#6962)
    • [AIRFLOW-XXXX] Add tips for writing a note in UPDATIND.md (#6960)
    • ๐Ÿ— [AIRFLOW-XXXX] Add note warning that bash>4.0 is required for docs build script (#6947)
    • [AIRFLOW-XXXX] Add autoenv to gitignore (#6946)
    • [AIRFLOW-XXXX] Fix GCSTaskHandler Comment Typo (#6928)
    • [AIRFLOW-XXXX] Fix broken DAG Serialization Link (#6891)
    • [AIRFLOW-XXXX] Add versions_added field to configs