Skip to content

随机创建一个UserAgent,避免大量爬取时服务器拒绝

Notifications You must be signed in to change notification settings

GuoKeLiDeHuanXiang2022/fake_UserAgent

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 

Repository files navigation

fake_UserAgent

随机创建一个UserAgent,避免大量爬取时服务器拒绝

导入

from fake_UserAgent import random_UserAgent

使用方法

伪装成chrome浏览器

response = requests.get(url=url, headers=random_UserAgent())

伪装成Edge浏览器

response = requests.get(url=url, headers=random_UserAgent(edge=True))

返回的内容举例

直接返回一个字典

{'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/86.0.4240.198 Safari/537.36'}
{'User-Agent': 'Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.60 Safari/537.36 Edg/103.0.1264.49'}

出现错误

如果请求出现错误,请自行修改第64行的 'User-Agent': f'{user_agent}' 为 'user-agent': f'{user_agent}' 后,再做尝试

63     header = {
64     'User-Agent': f'{user_agent}'
65 }

About

随机创建一个UserAgent,避免大量爬取时服务器拒绝

Topics

Resources

Stars

Watchers

Forks

Languages