New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ValueIterationGS _boundIter is incorrect #14

Open

sawcordwell opened this issue Apr 13, 2015 · 0 comments

Owner

sawcordwell commented Apr 13, 2015

The _boundIter method causes the algorithm to stop before it has reached the epsilon-optimal value function. Steps to reproduce:

import mdptoolbox.example
P, R = mdptoolbox.example.forest()
vigs = mdptoolbox.mdp.ValueIterationGS(P, R, 0.96)
vigs.setVerbose()
vigs.run()

What is expected: _boundIter should compute something that the algorithm can finish before, or it should not be used.

The text was updated successfully, but these errors were encountered:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment