All Versions
36
Latest Version
Avg Release Cycle
9 days
Latest Release
318 days ago

Changelog History
Page 1

  • v2.0.0 Changes

    December 07, 2020

    ๐Ÿ’ฅ Breaking changes

    ๐Ÿ†• New Functionalities

    โœจ Enhancements

    • ๐ŸŽ General performance improved for s3 I/O removing eventual consistency guardrails (Reference)
    • โž• Add retry with decorrelated jitter for Athena and Glue Catalog calls to overcome throttling in high concurrency scenarios.

    ๐Ÿ“„ Docs

    AWS re:Invent related news

    Thanks

    ๐Ÿš€ We thank the following contributors/users for their work on this release:

    @Brooke-white, @danielwo, @sapientderek, @pmleveque, @igorborgest.


    _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

  • v1.10.1 Changes

    November 26, 2020

    ๐Ÿ†• New Functionalities

    • catalog.add_column() #451
    • catalog.delete_column() #451

    โœจ Enhancements

    • Deterministic result for s3.read_parquet_metadata() #449
    • ๐Ÿ“ฆ ~30% faster package import time #460

    ๐Ÿ› Bug Fix

    • ๐Ÿ›  Fix Athena read with ctas_approach=False and chunksize=True #458
    • ๐Ÿ›  Fix overwriting for not enforced configs #450

    ๐Ÿ“„ Docs

    Thanks

    ๐Ÿš€ We thank the following contributors/users for their work on this release:

    @tuannguyen0901, @bryanyang0528, @czagoni, @jesusch, @danielwo, @DonghanYang, @eric-valente, @igorborgest.


    _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

  • v1.10.0 Changes

    October 31, 2020

    ๐Ÿ†• New Functionalities

    • โž• Add configurable Endpoint URL for AWS services #418
    • โž• Add global environment configuration for Athena workgroups #437

    โœจ Enhancements

    • ๐Ÿ‘Œ Support for Apache Arrow 2.0.0 #436
    • Allow Decimal to float casting for wr.db.read_sql_query() #431
    • Allow unsafe conversions for wr.db.read_sql_query() #427

    ๐Ÿ› Bug Fix

    • QuickSight functions now allow usernames with "/" #434
    • ๐Ÿ›  Fix duplicated carriage return for wr.s3.to_csv() running on Windows platform.

    Thanks

    ๐Ÿš€ We thank the following contributors/users for their work on this release:

    ๐Ÿ‘• @martinSpears-ECS, @imanebosch, @Eric-He-98, @brombach, @Thomas-Hirsch, @vuchetichbalint, @igorborgest.


    _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

  • v1.9.6 Changes

    October 10, 2020

    โœจ Enhancements

    • โž• Add encrypted glue connection management #413

    ๐Ÿ› Bug Fix

    • Double carriage return when using \r\n as line terminator (s3.to_csv()) #415
    • s3.read_parquet failing with some timezone aware columns #417

    Thanks

    ๐Ÿš€ We thank the following contributors/users for their work on this release:

    @jeanbaptistepriez, @mike-at-upside, @Thiago-Dantas, @igorborgest.


    _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

  • v1.9.5 Changes

    September 26, 2020

    โœจ Enhancements

    • General exceptions handling improvements #409
    • General error messages improvements #409

    ๐Ÿ› Bug Fix

    • [Parquet Read] Fix index recovery combined with columns filter #408

    ๐Ÿ“„ Docs

    • Handling and documenting ctas_approach for custom data sources #392

    Thanks

    ๐Ÿš€ We thank the following contributors/users for their work on this release:

    @tasq-inc, @igorborgest.


    _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

  • v1.9.4 Changes

    September 19, 2020

    โœจ Enhancements

    • โž• Add s3_additional_kwargs for wr.s3.copy_objects() and wr.s3.merge_datasets() #388
    • โž• Add data_source argument for Athena queries #392
    • Handling parquet tinyint columns on Redshift loads #400

    ๐Ÿ› Bug Fix

    • ๐Ÿ›  Fix issue with Hive partitions compatibility. #397
    • Fix missing catalog_id arguments in partitioned wr.s3.to_parquet() calls #399
    • โœ‚ Remove adaptive retry for boto3 resource. #403

    ๐Ÿ“„ Docs

    • โšก๏ธ Few updates.

    Thanks

    ๐Ÿš€ We thank the following contributors/users for their work on this release:

    @timgates42, @bvsubhash, @DonghanYang, @sl-antoinelaborde, @Xiangyu-C, @tuannguyen0901, @JPFrancoia, @sapientderek, @igorborgest.


    _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

  • v1.9.3 Changes

    September 08, 2020

    ๐Ÿ› Bug Fix

    • ๐Ÿ›  Fix bug for wr.s3.read_parquet() with timezone offset. #385

    Thanks

    ๐Ÿš€ We thank the following contributors/users for their work on this release:

    @chrisrana, @igorborgest.


    _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

  • v1.9.2 Changes

    September 07, 2020

    ๐Ÿ› Bug Fix

    • ๐Ÿ›  Fix issues in reading Parquet files with timestamp (timezone aware) columns. #382 #383

    Thanks

    ๐Ÿš€ We thank the following contributors/users for their work on this release:

    @tasq-inc, @chrisrana, @igorborgest.


    _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

  • v1.9.1 Changes

    September 05, 2020

    โœจ Enhancements

    • Significant Amazon S3 I/O speed up for big files #377
    • Create Parquet Datasets with columns with CamelCase names #380

    ๐Ÿ› Bug Fix

    • Read Parquet error for some files created by DMS #376

    ๐Ÿ“„ Docs

    • โšก๏ธ Few updates.

    Thanks

    ๐Ÿš€ We thank the following contributors/users for their work on this release:

    @jarretg, @chrisrana, @vikramshitole, @igorborgest.


    _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

  • v1.9.0 Changes

    September 01, 2020

    ๐Ÿ’ฅ Breaking changes

    • Global configuration s3fs_block_size was replaced by s3_block_size #370

    ๐Ÿ†• New Functionalities

    • Automatic recovery of Pandas indexes from Parquet files. #366
    • Automatic recovery of Pandas time zones from Parquet files. #366
    • Optional schema evolution disabling through the new schema_evolution argument. #353

    โœจ Enhancements

    • s3fs dependency was replaced by builtin code. #370
    • ๐Ÿšค Significant Amazon S3 I/O speed up for high latency environments (e.g. local, on-premises). #370

    ๐Ÿ› Bug Fix

    • ๐Ÿ‘Œ Improve NaN handling. #362
    • Sanitise table name for partitions insertion #360

    ๐Ÿ“„ Docs

    • โšก๏ธ Few updates.

    Thanks

    ๐Ÿš€ We thank the following contributors/users for their work on this release:

    @isrsal, @bppont, @weishao-aws, @alexifm, @Digma, @samcon, @TerrellV, @msantino, @alvaropc, @luigift, @igorborgest.


    _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!