« Changelog History


pyspider v0.3.5 Release Notes

Release Date: 2015-05-22 // almost 9 years ago
    • 🆕 New parameter: auto_recrawl - auto restart task every age.
    • New parameter: js_viewport_width/js_viewport_height to set viewport size for phantomjs engine.
    • 🆕 New command line option to set different message queue backends with URI scheme.
    • 🆕 New task level storage mechanism: self.save
    • 🆕 New redis taskdb
    • 🆕 New redis message queue.
    • 🆕 New high level message queue interface kombu.
    • 🛠 Fix bugs related to mongodb (keyword missing if not set).
    • 🛠 Fix phantomjs not work in all mode.
    • 🛠 Fix a potential deadlock in processor send_message.
    • ⏱ Default log level of scheduler is changed to INFO