Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

cloudflare-scrape is not able to bypass cloudflare checkings of this page https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest #444

Open
4 tasks done
deb4it opened this issue May 16, 2022 · 0 comments
Labels

Comments

@deb4it
Copy link

deb4it commented May 16, 2022

Have upgrade cfscrape using this command
pip install -U cfscrape

$ node --version
v14.15.4

https://www.ricardo.ch is actually using anti-bot protection by Cloudflare

Please confirm the following statements and check the boxes before creating an issue:

  • I've upgraded cfscrape with pip install -U cfscrape
  • I'm using Node version 10 or higher
  • The site protection I'm having issues with is from Cloudflare
  • I'm not using Tor, a VPN, or an anonymizing proxy

Python version number

$ python --version
Python 3.9.1

cfscrape version number

$ pip show cfscrape
Name: cfscrape
Version: 2.1.1
Summary: A simple Python module to bypass Cloudflare's anti-bot page. See https://github.com/Anorov/cloudflare-scrape for more information.
Home-page: https://github.com/Anorov/cloudflare-scrape
Author: Anorov
Author-email: [email protected]
License: UNKNOWN
Location: c:\users\user\appdata\local\programs\python\python39\lib\site-packages
Requires: requests
Required-by:

Code snippet involved with the issue

import cfscrape
scraper = cfscrape.create_scraper(delay=15)
html = scraper.get("https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest").content
print(html)

Complete exception and traceback

In response I see cludflare's message contains like below

If you are on a personal connection, like at home, you can run an anti-virus scan on your device to make sure it is not infected with malware.

If you are at an office or shared network, you can ask the network administrator to run a scan across the network looking for misconfigured or infected devices.

URL of the Cloudflare-protected page

[https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest]

URL of Pastebin/Gist with HTML source of protected page

https://www.ricardo.ch/de/s/iphone?ignore_dominant=true&sort=newest

@deb4it deb4it added the bug label May 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant