Changelog History
Page 1
-
v2.0.0 Changes
December 07, 2020๐ฅ Breaking changes
sqlalchemy
andpsycopg2
dependencies replaced byredshift_connector
andpg8000
- All
wr.db.*
functions was distributed intowr.redshift.*
,wr.postgresql.*
andwr.mysql.*
(Tutorial) - ๐จ Redshift COPY and UNLOAD function was refactored into
wr.redshift.*
(Tutorial) - โ
wr.catalog.get_engine()
was replaced bywr.redshift.connect()
,wr.postgresql.connect()
,wr.mysql.connect()
(Tutorial)
๐ New Functionalities
โจ Enhancements
- ๐ General performance improved for s3 I/O removing eventual consistency guardrails (Reference)
- โ Add retry with decorrelated jitter for Athena and Glue Catalog calls to overcome throttling in high concurrency scenarios.
๐ Docs
- โก๏ธ Updates regarding all new functionalities
- โ Add Amazon Timestream tutorial
- โ Add Amazon Timestream tutorial 2
AWS re:Invent related news
- ๐ AWS Lambda now supports up to 10 GB of memory and 6 vCPU cores
- Amazon S3 now delivers strong read-after-write consistency
- ๐ AWS Lambda now supports container images as a packaging format
- โฑ Serverless Batch Scheduling with AWS Batch and AWS Fargate
Thanks
๐ We thank the following contributors/users for their work on this release:
@Brooke-white, @danielwo, @sapientderek, @pmleveque, @igorborgest.
_ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!
-
v1.10.1 Changes
November 26, 2020๐ New Functionalities
โจ Enhancements
๐ Bug Fix
- ๐ Fix Athena read with
ctas_approach=False
andchunksize=True
#458 - ๐ Fix overwriting for not enforced configs #450
๐ Docs
Thanks
๐ We thank the following contributors/users for their work on this release:
@tuannguyen0901, @bryanyang0528, @czagoni, @jesusch, @danielwo, @DonghanYang, @eric-valente, @igorborgest.
_ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!
- ๐ Fix Athena read with
-
v1.10.0 Changes
October 31, 2020๐ New Functionalities
- โ Add configurable Endpoint URL for AWS services #418
- โ Add global environment configuration for Athena workgroups #437
โจ Enhancements
- ๐ Support for Apache Arrow 2.0.0 #436
- Allow Decimal to float casting for
wr.db.read_sql_query()
#431 - Allow unsafe conversions for
wr.db.read_sql_query()
#427
๐ Bug Fix
- QuickSight functions now allow usernames with "/" #434
- ๐ Fix duplicated carriage return for
wr.s3.to_csv()
running on Windows platform.
Thanks
๐ We thank the following contributors/users for their work on this release:
๐ @martinSpears-ECS, @imanebosch, @Eric-He-98, @brombach, @Thomas-Hirsch, @vuchetichbalint, @igorborgest.
_ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!
-
v1.9.6 Changes
October 10, 2020โจ Enhancements
- โ Add encrypted glue connection management #413
๐ Bug Fix
- Double carriage return when using \r\n as line terminator (
s3.to_csv()
) #415 s3.read_parquet
failing with some timezone aware columns #417
Thanks
๐ We thank the following contributors/users for their work on this release:
@jeanbaptistepriez, @mike-at-upside, @Thiago-Dantas, @igorborgest.
_ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!
-
v1.9.5 Changes
September 26, 2020โจ Enhancements
๐ Bug Fix
- [Parquet Read] Fix index recovery combined with columns filter #408
๐ Docs
- Handling and documenting ctas_approach for custom data sources #392
Thanks
๐ We thank the following contributors/users for their work on this release:
_ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!
-
v1.9.4 Changes
September 19, 2020โจ Enhancements
- โ Add
s3_additional_kwargs
forwr.s3.copy_objects()
andwr.s3.merge_datasets()
#388 - โ Add
data_source
argument for Athena queries #392 - Handling parquet
tinyint
columns on Redshift loads #400
๐ Bug Fix
- ๐ Fix issue with Hive partitions compatibility. #397
- Fix missing catalog_id arguments in partitioned
wr.s3.to_parquet()
calls #399 - โ Remove adaptive retry for boto3 resource. #403
๐ Docs
- โก๏ธ Few updates.
Thanks
๐ We thank the following contributors/users for their work on this release:
@timgates42, @bvsubhash, @DonghanYang, @sl-antoinelaborde, @Xiangyu-C, @tuannguyen0901, @JPFrancoia, @sapientderek, @igorborgest.
_ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!
- โ Add
-
v1.9.3 Changes
September 08, 2020๐ Bug Fix
- ๐ Fix bug for
wr.s3.read_parquet()
with timezone offset. #385
Thanks
๐ We thank the following contributors/users for their work on this release:
_ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!
- ๐ Fix bug for
-
v1.9.2 Changes
September 07, 2020๐ Bug Fix
Thanks
๐ We thank the following contributors/users for their work on this release:
@tasq-inc, @chrisrana, @igorborgest.
_ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!
-
v1.9.1 Changes
September 05, 2020โจ Enhancements
- Significant Amazon S3 I/O speed up for big files #377
- Create Parquet Datasets with columns with CamelCase names #380
๐ Bug Fix
- Read Parquet error for some files created by DMS #376
๐ Docs
- โก๏ธ Few updates.
Thanks
๐ We thank the following contributors/users for their work on this release:
@jarretg, @chrisrana, @vikramshitole, @igorborgest.
_ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!
-
v1.9.0 Changes
September 01, 2020๐ฅ Breaking changes
- Global configuration
s3fs_block_size
was replaced bys3_block_size
#370
๐ New Functionalities
- Automatic recovery of Pandas indexes from Parquet files. #366
- Automatic recovery of Pandas time zones from Parquet files. #366
- Optional schema evolution disabling through the new
schema_evolution
argument. #353
โจ Enhancements
s3fs
dependency was replaced by builtin code. #370- ๐ค Significant Amazon S3 I/O speed up for high latency environments (e.g. local, on-premises). #370
๐ Bug Fix
๐ Docs
- โก๏ธ Few updates.
Thanks
๐ We thank the following contributors/users for their work on this release:
@isrsal, @bppont, @weishao-aws, @alexifm, @Digma, @samcon, @TerrellV, @msantino, @alvaropc, @luigift, @igorborgest.
_ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!
- Global configuration