Pomp v0.2.0 Release Notes
-
🚀 Released at 2016-03-01
- 🚚 middlewares logic moved to engine and BaseMiddleware.process_(request|response|exception) with crawler and downloader params
- Downloader does not have any more middlewares param
- BaseDownloaderMiddleware renamed to BaseMiddleware
- BaseDownloderException renamed to BaseCrawlException
- 👍 AioConcurrentCrawler with asyncio and concurrent futures support
- 🚚 pomp.core.item moved to pomp.contrib.item without backward compatibility https://github.com/estin/pomp/issues/6#issuecomment-172342598
- 👍 AioPomp with asyncio support
- queue semaphore to prevent fetching more requests than downloader can process now
- 🔧 bfo and dfo orders now configured via Pomp constructor
- no recursion, internal queue is used
- twsited is not a part of pomp
- defer object replaced to Planned object (like Future object)