« Changelog History


Grab v0.6.33 Release Notes

Release Date: 2017-01-28 // about 7 years ago

  • ➕ Added

    • ➕ Add API documentation about few grab modules, by @rushter
    • 🏁 Start running Grab tests in Windows enviroment on appveyor CI
    • 🆕 New spider transport based on threads that allows to use Spider with any Grab network backend e.g. urllib3
    • Add remove_from_post option to grab.doc.submit method
    • ➕ Add random option to grab.change_proxy method
    • 👌 Support for deprecated attributes Spider.items and Spider.counters
    • If Spider handler raises ResponseNotValid exception, then that task goes back to task queue until task.task_try_count reaches the spider.task_try_limit

    🔄 Changed

    • 🔨 Refactor management of internal threads, fix random test failures related to cache sub-module
    • 0️⃣ Disable default logging to files while running spider by run crawl command
    • Multiple improvements in urllib3 transport
    • 0️⃣ Set default spider network & try limits to 3 (was 10)

    🛠 Fixed

    • Different bugs in urllib3 transport
    • Different bugs

    ✂ Removed

    • Remove grab.use_next_proxy method
    • ✂ Remove grab.dump method
    • ✂ Remove deprecated Spider methods and attributes