解决selenium偶尔抓不到element的问题

[Superskyyy]

• 思路1

selenium获取到cookie，然后用其他框架爬

• 思路2

用selenium往页面嵌js，做预处理（√）

• 思路3

写一个更高级的脚本系统来引导python

[Superskyyy]

A workaround is skipping both that is "UNSP" -- indicates a blank stub course. and <Title> contains a "***" -- indicates the course has multiple offerings. These will be the only two types of courses observed so far, which goes against the overall structure.

The further solution will be adapting thought 2 into code. After all, selenium is the safest way to do such scraping, due to its nature of mimicking human inputs from an actual browser. We also need to add random delays between each page call, preventing IP/ account bans.