Fix flaky redirect test

[katiemcculloch]

This test fails a lot and usually passes when re-run. I'm not 100% sure it can be fixed, or if its an issue with github actions doing too many CI rans at once. But since this is the one test that consistently fails during github action dependency bumps, there might be a way to make it less flaky.