Crawlector v2.3

Munich Release.

[?] Released on (November 24, 2023)
[+] Added the capability to specify a list of DNS nameservers for all DNS queries and DNS-to-IP resolutions attempted by Crawlector
with a high level of control. It supports DNS over TLS.
- Check README "DNS Nameservers" section for an in-depth description
[?] README and configuration file have all the information

Crawlector v2.2

Hallstatt Release.

[?] Released on (November 05, 2023)
[+] Added the feature Slack Remote Control to provide the capability to remotely control Crawlector via a selected set of specially
designed control commands
- Check README "Slack Remote Control" section for an in-depth description
[?] The option upgrade2https will be disabled if the cert option is enabled
[?] In most cases, Crawlector attempts to validate if a given website is reachable or not. In earlier versions, it was done via
a GET request, but in this release, the implementation has been updated to only Connect to the website via ports 443 and 80,
respectively
[?] README and configuration file have all the information

Crawlector v2.1

Universe-647 Release.

[?] Released on (October 03, 2023)
[+] Added the feature Slack Alert Notification to provide a mechanism to monitor the execution of Crawlector in real time,
by sending Yara's alerts, std::exit() events, progress information, and process warnings and errors, to a Slack channel of your choosing
- Check the README "Slack Alert Notification" section for an in-depth description
[+] Added the option cert_dir to the [certificate] section in the configuration file
[?] Fixed a bug in the CSV log file when DOE is enabled (the number of columns was off by one)
[?] README and configuration file have all the information

Crawlector v2.0

Photoid Release.

[?] Released on (September 18, 2023)
[?] This is a milestone release
[+] Added Deep Object Extraction (DOE)
- Check README "Deep Object Extraction (DOE)" section for in-depth description
[+] Added full support for HTTP redirection
- Check README "Redirection Functionality" section for more information
[+] In release 2.0, the ids have their types explicitly assigned by appending a specific type substring to the id itself
[+] Added the command line options "-v" and "-c".
- The option "-v" is for printing version info to the console.
- The option "-c" is for reading a different configuration file, other than the default "cl_config.ini"
[+] Added the options clear_dns and upg_2_https to the [default] section
[+] Added the options rapid_api_weeks and rapid_api_limit to the [site] section for configuring the API request to RapidAPI
[+] Added the whois_info option which retrieves whois domain information including, registrar, registered_on, expires_on and updated_on
[+] Added the option page_title to grab the page title
[*] Upgraded Yara engine to 4.3.2
[+] Various code optimizations and minor improvements
- Check README "Miscellaneous Improvements in Version 2.0" section for other additions
[?] README and configuration file have all the information

Crawlector v1.2

Metamorphosis Release.

[?] Released on (March 10, 2023)
[+] Major improvement on the [site] section functionality for finding subdomains and TLDs
- README and configuration file have all the information
[*] Some other minor changes

/* ----------------------- */
Updated March 14, 2023

[*] I shipped Version 1.2 with my RapidAPI key, so, I've deleted it from the configuration file. Please refrain from using it. Either way, the key has been rotated.
[?] No other changes were made

Crawlector v1.1

Singapore Release.

[?] Released on (December 02, 2022) - Avar 2022 Conference
[+] Added the site ranking feature
- Check the section [site_ranking] in the configuration file for more information
[*] Some other minor changes

Crawlector v1.0

Bergamo Release.