You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for your great work. I want to apply RAIN to Mistral ([https://huggingface.co/HuggingFaceH4/mistral-7b-sft-beta]) on HH test set. I only changed scripts of loading dataset in main.py (I want inference on entire test set, thus I just set ds1 = ds):
The task lasts for 17 hours, but in res_x.json(x=0,1,2,3,4,5,6,7) there is still only the same first question with answers. I think --s and --e will not work, no matter how I set them. But multiple processes seem to inference on the same data? And the inference is very very very slow ...
The text was updated successfully, but these errors were encountered:
Thanks for your great work. I want to apply RAIN to Mistral ([https://huggingface.co/HuggingFaceH4/mistral-7b-sft-beta]) on HH test set. I only changed scripts of loading dataset in
main.py
(I want inference on entire test set, thus I just setds1 = ds
):Then I run this command:
The task lasts for 17 hours, but in
res_x.json
(x=0,1,2,3,4,5,6,7
) there is still only the same first question with answers. I think--s
and--e
will not work, no matter how I set them. But multiple processes seem to inference on the same data? And the inference is very very very slow ...The text was updated successfully, but these errors were encountered: