The All in One Framework to build Awesome Scrapers.
-
Updated
May 23, 2024 - Python
The All in One Framework to build Awesome Scrapers.
Protect your website from bots with Prosopo Procaptcha
The Universal Device Detection library will parse any User Agent and detect the browser, operating system, device used (desktop, tablet, mobile, tv, cars, console, etc.), brand and model.
Caterpillar Proxy - The simple and parasitic web proxy with SPAM filter (formerly, php-httpproxy)
This is a client module to automate the Mozilla Firefox browser via the Marionette protocol
Automate the control over the visitors of your MyBB site
Simple package for adding directives to show/hide content from crawlers
📊 Python's all-in-one framework for web crawling, scraping, testing, and reporting. Supports pytest. UC Mode provides stealth. Includes many tools.
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MIT license, no usage restrictions.
Fingerprint Pro Akamai Integration is responsible for proxying identification and JavaScript agent download requests that are performed on your Akamai infrastructure.
IP Intelligence is a free Proxy VPN TOR and Bad IP detection tool to prevent Fraud, stolen content, and malicious users. Block proxies, VPN connections, web host IPs, TOR IPs, and compromised systems with a simple API. GeoIP lookup available.
REST API agent string parser for Docker based on Udger https://udger.com/products/local_parser
realtime page bot detection, XSS detection and performance analytics tracker for the web
The Universal Device Detection library will parse any User Agent and detect the browser, operating system, device used (desktop, tablet, mobile, tv, cars, console, etc.), brand and model.
Golang module to detect bots and crawlers via the user agent
Ruby gem to detect bots and crawlers via the user agent
Repository for paper Spot the Bot: Inverse Problems of NLP, by Gromov V.A., Dang Q.N., Kogan A.S., Yerbolova A.S..
Add a description, image, and links to the bot-detection topic page so that developers can more easily learn about it.
To associate your repository with the bot-detection topic, visit your repo's landing page and select "manage topics."