Releases: tijme/not-your-average-web-crawler
Releases · tijme/not-your-average-web-crawler
1.2.3
Improvement(s):
- Compatibility for Python 3.3, 3.4 & 3.5
Fixed bug(s):
- Random order of query parameters in crawled URLs
1.2.2
New feature(s):
- GitHub's contribution templates
- PyPi classifiers
1.2.1
1.2.0
New feature(s):
- XML scraping
- Custom cookies
- Custom user agent
Fixed bug(s):
- Incorrect regex scraper URLs
- Removed mailto link scraping
- Crash on DNS exception
- Crash on invalid Python version
1.1.0
New feature(s):
- Multi-threading
Fixed bug(s):
- Missing button element in form scraper
- Incorrect regex scraper URLs
1.0.1
New feature(s):
- Callbacks
- Scope options
- Link crawling in HTML and JavaScript
- Form crawling in HTML (GET & POST)