Scrapy v2.3.0 Release Notes
Release Date: 2020-08-04 // over 3 years ago-
Hihglights:
๐ Feed exports now support Google Cloud Storage as a storage backend
The new
FEED_EXPORT_BATCH_ITEM_COUNT
setting allows to deliver output items in batches of up to the specified number of items.โช It also serves as a workaround for delayed file delivery, which causes Scrapy to only start item delivery after the crawl has finished when using certain storage backends (S3, FTP, and now GCS).
๐ The base implementation of item loaders has been moved into a separate library, itemloaders, allowing usage from outside Scrapy and a separate release schedule