Scaling the benchmark #313
imenelydiaker
started this conversation in
General
Replies: 2 comments 3 replies
-
|
Beta Was this translation helpful? Give feedback.
0 replies
-
Hi @imenelydiaker, I do was trying subsampling; However, I keep getting MTEB Evaluation error. Is there something I am missing, have you tried subsampling if so can you guide me a bit? Error -> ERROR:mteb.evaluation.MTEB:Error while evaluating RedditClustering: Found input variables with inconsistent numbers of samples: [7194, 17] Basically I was trying to only run for 17 sentences in RedditClustering dataset. |
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Think about how to make the benchmark faster:
Any other suggestions?
@KennethEnevoldsen @MartinBernstorff @Muennighoff feel free to edit my post and add details
Beta Was this translation helpful? Give feedback.
All reactions