Skip to content

Issues: LAION-AI/CLIP_benchmark

generate diagram as part of the cli
#80 opened Feb 3, 2023 by rom1504
Open 1
Make a training companion eval script
#2 opened Jul 31, 2022 by rom1504
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

29 Open 36 Closed
29 Open 36 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Webdatasets for Linear Probe evaluation
#127 opened May 27, 2024 by shrebox
2
Questions about example for COCO captions captioning task
#126 opened May 16, 2024 by strongweight
Leaking Validation Data in Few-Shot-Setting
#125 opened May 3, 2024 by MarcoMorik
Duplicated imagenet1k classnames: "missile" & "sunglasses"
#124 opened Mar 31, 2024 by EIFY
additional argument not recognized in MODEL_TYPES
#123 opened Mar 21, 2024 by arnabk001
update ImageNet V2 download urls
#122 opened Mar 20, 2024 by shyammarjit
What is the composition of the dataset for model training
#121 opened Feb 5, 2024 by geekchen007
2
Update babel image net
#117 opened Jan 17, 2024 by rom1504
Add support of zero-shot classification/retrieval evaluation of captioning models using log-likelihood scoring, e.g. LLaVA, and others
#115 opened Jan 4, 2024 by mehdidc
Support computing metrics using test time distribution normalisation
#112 opened Nov 1, 2023 by rom1504
Add compositionality benchmarks new datasets
#97 opened Jun 30, 2023 by mehdidc
8
AttributeError: 'JaCLIPForBenchmark' object has no attribute 'eval'
#93 opened May 26, 2023 by pkhk-1
1
generate diagram as part of the cli important UX
#80 opened Feb 3, 2023 by rom1504
1
Attribute based eval new datasets
#72 opened Jan 26, 2023 by rom1504
3
Evaluate mse aligned multilingual clip new model
#69 opened Jan 20, 2023 by rom1504
2
Organize CLI arguments into groups UX
#66 opened Jan 13, 2023 by djghosh13
Add forensic/exif tasks new datasets
#65 opened Jan 12, 2023 by rom1504
Variation in the benchmark bug Something isn't working
#59 opened Dec 26, 2022 by mehdidc
1
add multi30k for eval new datasets
#46 opened Nov 28, 2022 by elliottd
1
add xm3600 for multilingual eval new datasets
#44 opened Nov 23, 2022 by rom1504
Support ImageNet-X new datasets
#41 opened Nov 21, 2022 by mehdidc
add multilingual task from mural new datasets
#35 opened Nov 19, 2022 by rom1504
add chinese retrieval tasks new datasets
#33 opened Nov 18, 2022 by rom1504
1
Add XMRec multilingual retrieval benchmark new datasets
#31 opened Nov 15, 2022 by rom1504
Potential using mis-ordered KITTI prompt new datasets
#21 opened Nov 10, 2022 by haooooooqi
3
ProTip! Add no:assignee to see everything that’s not assigned.