-
Notifications
You must be signed in to change notification settings - Fork 117
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Possible missuse of artm.Dictionary: save/load cause interoperability problems #986
Comments
Further down the same line, it was discovered that Perplexity score initialization with or without a dictionary leads to inconsistent behaviour. Examples are:
These two models being trained on the same data yeild different training results with last perplexity value for 0.10.0 version of artm being 2.887 for the first model and 3.027 for the second one. However for 0.9.0 these values are different: 2.887 for the first model and 0.0 for the second one. |
Working with the library came across the following issue:
if Dictionary instance is recreated by any means (e.g. load from initial batches or from a saved dictionary), while the original instance is lost or overwritten score trackers stop returning score values.
Here is the minimal code to reproduce the error:
I conjecture that it's related to the following:
(note that
dictionary.name
is the same in all cases)The text was updated successfully, but these errors were encountered: