Grab v0.6.33 Release Notes

Release Date: 2017-01-28 // over 5 years ago
  • โž• Added

    • โž• Add API documentation about few grab modules, by @rushter
    • ๐Ÿ Start running Grab tests in Windows enviroment on appveyor CI
    • ๐Ÿ†• New spider transport based on threads that allows to use Spider with any Grab network backend e.g. urllib3
    • Add remove_from_post option to grab.doc.submit method
    • โž• Add random option to grab.change_proxy method
    • ๐Ÿ‘Œ Support for deprecated attributes Spider.items and Spider.counters
    • If Spider handler raises ResponseNotValid exception, then that task goes back to task queue until task.task_try_count reaches the spider.task_try_limit

    ๐Ÿ”„ Changed

    • ๐Ÿ”จ Refactor management of internal threads, fix random test failures related to cache sub-module
    • 0๏ธโƒฃ Disable default logging to files while running spider by run crawl command
    • Multiple improvements in urllib3 transport
    • 0๏ธโƒฃ Set default spider network & try limits to 3 (was 10)

    ๐Ÿ›  Fixed

    • Different bugs in urllib3 transport
    • Different bugs

    โœ‚ Removed

    • Remove grab.use_next_proxy method
    • โœ‚ Remove grab.dump method
    • โœ‚ Remove deprecated Spider methods and attributes