-
Notifications
You must be signed in to change notification settings - Fork 13
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Cannot reproduce the PVQ numbers in test_PVQ_on_new_datasets.ipynb #10
Comments
jonfryd
changed the title
Cannot reproduce the PVC numbers in test_PVQ_on_new_datasets.ipynb
Cannot reproduce the PVQ numbers in test_PVQ_on_new_datasets.ipynb
Jun 10, 2022
I tried running everything in a Jupyter notebook today to check if I had made a mistake maybe while breaking up the functionality of the full notebook into smaller Python scripts. Well, it's still the same issue as shown above. The SRCC and LCC values are off by quite a bit compared to the expected values. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi,
Very interesting work!
So for fun I tried following every step in
test_PVQ_on_new_datasets.ipynb
(the only difference being that I'm running a bunch of smaller Python programs instead a Jupyter notebook), but I'm getting different values onLIVE_VQC_tiny_all
:Instead of 0.548,0.515 as stated in
test_PVQ_on_new_datasets.ipynb
. Are the numbers in the Jupyter notebook outdated perhaps?I verified every intermediate step and everything seems to be OK in terms of tensor sizes and so on.
I'm curious if anyone has been able to reproduce the stated PVQ numbers successfully from the Jupyter notebook.
The text was updated successfully, but these errors were encountered: