spidy Web Crawler v1.2 Release NotesRelease Date: 2017-09-07 // over 4 years ago
➕ Added domain restrictions. Crawling can now be limited to a certain domain, such as
https://www.wsj.com/article. Can be set when entering configuration settings or in the config files.
🛠 Also more bugfixes and MIME types because those are cool.