Skip to content

Issues: beir-cellar/beir

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

72 Open 69 Closed
72 Open 69 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Incorrect Evaluation Metrics Produced
#187 opened Nov 1, 2024 by NikhielRahulSingh
1
你们的IDCG计算是什么方式
#186 opened Oct 14, 2024 by wangjitoan
evaluate_sbert_multi_gpu run error
#185 opened Sep 29, 2024 by ET-yzk
BUG - EvaluateRetrieval's evaluate doesn't consider results dict order
#184 opened Sep 12, 2024 by vd-omermazig
how was the hotpot_qa dataset preprocessed?
#181 opened Sep 2, 2024 by DanielSchuhmacher
NQ - File datasets/nq/qrels/train.tsv not present
#179 opened Jul 29, 2024 by GiacoL
6
can't reproduce DeepCT results with evaluate_deepct.py
#176 opened Jun 17, 2024 by jeka-e
recommended pytrec-eval-terrier rather than pytrec-eval
#174 opened Jun 1, 2024 by liyongkang123
mt5-base model (unicamp-dl/mt5-base-en-msmarco) throws 'nan' outputs
#173 opened May 31, 2024 by cramraj8
Missing document from corpus ArguAna
#172 opened May 13, 2024 by NourOM02
How to Save Retrieved Documents in Retrieval Tasks
#171 opened May 11, 2024 by AugustLHHHHHH
retriever.retrieve(corpus, queries) with len(queries)==1 errors
#170 opened Apr 17, 2024 by manestay
1
Why need check corpus_id != query_id in DenseRetrievalExactSearch.search()
#169 opened Apr 11, 2024 by mengyao00
1
Rename Accuracy@k Metric to Success@k metric
#166 opened Mar 10, 2024 by root-goksenin
Corpus encoding times for hotpotqa on A100 GPU
#165 opened Feb 27, 2024 by jeyendranbalakrishnan
example file, train_msmarco_v2.py is not working
#163 opened Feb 13, 2024 by baekingeol
Malformed Chinese mMARCO dataset
#161 opened Jan 10, 2024 by sissilab
Extras-require, base package without Faiss-CPU requirement
#160 opened Oct 30, 2023 by raphaelsty
1
mMarco version
#159 opened Oct 20, 2023 by carlesoctav
Installation
#157 opened Sep 18, 2023 by malinphy
3
Fine-tuned Cross-encoder scores are lower than ms-marco zero-shot scores ?
#156 opened Sep 15, 2023 by cramraj8
1
Typing for retriever is too strict: implement abstract retriever base class
#152 opened Jul 10, 2023 by jon-chuang
org.apache.lucene.search.BooleanQuery$TooManyClauses: maxClauseCount is set to 1024
#151 opened Jul 2, 2023 by 0ddAstronaut
Redirect Anserini BM25 baselines in BEIR to Pyserini
#149 opened Jun 20, 2023 by thakur-nandan
4 tasks
@lintool @thakur-nandan
evaluate_anserini_bm25.py retrieves 1000 documents for each query no matter which k I set in payload
#146 opened Jun 16, 2023 by zhiyuanpeng
2
ProTip! Mix and match filters to narrow down what you’re looking for.