AWS Data Wrangler latest version

« Changelog History

AWS Data Wrangler v2.0.0 Release Notes

• 💥 Breaking changes

  • sqlalchemy and psycopg2 dependencies replaced by redshift_connector and pg8000
  • All wr.db.* functions was distributed into wr.redshift.*, wr.postgresql.* and wr.mysql.* (Tutorial)
  • 🔨 Redshift COPY and UNLOAD function was refactored into wr.redshift.* (Tutorial)
  • ✅ wr.catalog.get_engine() was replaced by wr.redshift.connect(), wr.postgresql.connect(), wr.mysql.connect() (Tutorial)

  🆕 New Functionalities

  • ✅ Amazon Timestream support (Tutorial)

  ✨ Enhancements

  • 🐎 General performance improved for s3 I/O removing eventual consistency guardrails (Reference)
  • ➕ Add retry with decorrelated jitter for Athena and Glue Catalog calls to overcome throttling in high concurrency scenarios.

  📄 Docs

  • ⚡️ Updates regarding all new functionalities
  • ➕ Add Amazon Timestream tutorial
  • ➕ Add Amazon Timestream tutorial 2

  AWS re:Invent related news

  • 👍 AWS Lambda now supports up to 10 GB of memory and 6 vCPU cores
  • Amazon S3 now delivers strong read-after-write consistency
  • 👍 AWS Lambda now supports container images as a packaging format
  • ⏱ Serverless Batch Scheduling with AWS Batch and AWS Fargate

  Thanks

  🚀 We thank the following contributors/users for their work on this release:

  @Brooke-white, @danielwo, @sapientderek, @pmleveque, @igorborgest.

  ---

  _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

Previous changes from v1.10.1

• 🆕 New Functionalities

  • catalog.add_column() #451
  • catalog.delete_column() #451

  ✨ Enhancements

  • Deterministic result for s3.read_parquet_metadata() #449
  • 📦 ~30% faster package import time #460

  🐛 Bug Fix

  • 🛠 Fix Athena read with ctas_approach=False and chunksize=True #458
  • 🛠 Fix overwriting for not enforced configs #450

  📄 Docs

  • 🛠 Small fixes #462 #458 #446

  Thanks

  🚀 We thank the following contributors/users for their work on this release:

  @tuannguyen0901, @bryanyang0528, @czagoni, @jesusch, @danielwo, @DonghanYang, @eric-valente, @igorborgest.

  ---

  _ P.S. _ Lambda Layer zip file and Glue wheel/egg files are available below. Just upload it and run!

• All Versions
• Previous v1.10.1