All Versions
10
Latest Version
Avg Release Cycle
64 days
Latest Release
51 days ago

Changelog History

  • v1.7.3

    August 01, 2019

    Enforce lxml 4.3.5 or lower for Python 3.4 (#3912, #3918)

  • v1.7.2

    July 23, 2019

    🛠 Fix Python 2 support (#3889, #3893, #3896)

  • v1.7.1

    July 18, 2019
  • v1.7.0

    July 18, 2019

    Highlights:

    • 👌 Improvements for crawls targeting multiple domains
    • A cleaner way to pass arguments to callbacks
    • A new class for JSON requests
    • 👌 Improvements for rule-based spiders
    • 🆕 New features for feed exports

    👀 See the full change log

  • v1.6.0

    February 11, 2019

    Highlights:

    • 👍 Better Windows support
    • Python 3.7 compatibility
    • 📚 Big documentation improvements, including a switch from .extract_first() + .extract() API to .get() + .getall() API
    • Feed exports, FilePipeline and MediaPipeline improvements
    • Better extensibility: item_error and request_reached_downloader signals; from_crawler support for feed exporters, feed storages and dupefilters.
    • 🛠 scrapy.contracts fixes and new features
    • 🚀 Telnet console security improvements, first released as a backport in Scrapy 1.5.2 (2019-01-22)
    • 🗄 Clean-up of the deprecated code
    • 🛠 Various bug fixes, small new features and usability improvements across the codebase.

    Full changelog is in the docs.

  • v1.5.2

    January 22, 2019
  • v1.5.1

    July 11, 2018
  • v1.5.0

    December 30, 2017

    🚀 This release brings small new features and improvements across the codebase.
    Some highlights:

    • 👍 Google Cloud Storage is supported in FilesPipeline and ImagesPipeline.
    • Crawling with proxy servers becomes more efficient, as connections to proxies can be reused now.
    • ⚠ Warnings, exception and logging messages are improved to make debugging easier.
    • 📜 scrapy parse command now allows to set custom request meta via --meta argument.
    • ✅ Compatibility with Python 3.6, PyPy and PyPy3 is improved; PyPy and PyPy3 are now supported officially, by running tests on CI.
    • 👍 Better default handling of HTTP 308, 522 and 524 status codes.
    • 📚 Documentation is improved, as usual.

    Full changelog is in the docs.