-
-
Notifications
You must be signed in to change notification settings - Fork 605
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
INFO: Resuming from iteration for provided data will fetch data until required iteration ... #3247
Comments
The message means that deterministic engine is trying to resume the run from some non-zero iteration. For deterministic engines we have to rewind dataloader up to the resuming iteration otherwise randomness state wont be fully respected (probably here there can be more context: https://pytorch.org/ignite/engine.html#dataflow-synchronization). Given the code you provide, I would say this is more like a bug. |
Do you mean a bug in ignite or in my code?
I am not stopping any of the valid_engines, they all run for a single full epoch of validation after each training epoch |
Difficult to say like that. Is it possible that you could provide more code to repro the issue ? |
❓ Questions/Help/Support
I observed in the training logs the message that I don't understand, could you please clarify what happens here and why?
This happens for all validation engines I have, that I create as follows:
Note: I use DeterministicEngine for all engines (training and validation)
The text was updated successfully, but these errors were encountered: