Feature Request: Add Scheduled/Batch Recrawl

[meng8131]

Manually clicking "recrawl" for each item is inefficient, especially with many items. I propose:

Scheduled Recrawls: Automatic recrawls on a schedule (e.g., daily, weekly).
Batch Recrawl: A button to recrawl all items at once.
Batch recrawl would be a significant improvement; scheduled recrawls would be even better.

Thanks!

[MohamedBassem]

In the UI of broken links, that makes sense. However the button already exists in the admin panel for batch recrawling failed links. There's a difference in semantics though, the button in admin panel doesn't recrawl pages that hit non 200 status code though.