New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Follow redirects #8

Open

nazuke opened this issue Sep 28, 2017 · 0 comments

Assignees

Labels

Owner

nazuke commented Sep 28, 2017

The Follow redirects preferences setting does not appear to be working properly.

For example, a redirect from http://www.hostname.com/ to http://hostname.com/ does not result in the latter being crawled, when it should.

nazuke self-assigned this

nazuke added the bug label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment