Skip to content

Releases: embeddings-benchmark/mteb

1.26.5

08 Jan 14:25
Compare
Choose a tag to compare

1.26.5 (2025-01-08)

Ci

  • ci: Refresh the v2 leaderboard daily (#1711)

  • Create leaderboard_refresh.yaml

  • Shorten and fix

  • factory reset instead of normal (25f4f61)

Fix

  • fix: rollback BUCC revision (#1706)

  • fix bucc

  • fix logger

  • upd evaluator

  • add comment

  • lint (9bcb52f)

Unknown

  • Fix: typos in adding a model (#1722) (ab8805c)

  • Fix: minicpmv2 (#1705)

  • updmini cpm

  • flash_attn implementation

  • remove flash attn (222bb35)

1.26.4

04 Jan 11:27
Compare
Choose a tag to compare

1.26.4 (2025-01-04)

Fix

  • fix: GermanDPR (#1703)

  • fix GermanDPR

  • lint (753d08a)

  • fix: Register MicroLlama Text Embedding (#1644)

Register MicroLlama Text Embedding (6d1d9f4)

Unknown

1.26.3

03 Jan 11:45
Compare
Choose a tag to compare

1.26.3 (2025-01-03)

Fix

  • fix: NanoBeir (#1687)

  • fix nano beir

  • lint (cff7ed8)

  • fix: nomic prompts (#1685)

  • fix nomic prompts

  • fix variable model name

  • pass prompts to model

  • use sentence transformer wrapper

  • update prompts

  • lint

  • update prompts

  • update list for classification (808257c)

1.26.2

03 Jan 08:59
Compare
Choose a tag to compare

1.26.2 (2025-01-03)

Fix

  • fix: update model loader to trust remote code (#1697)

update model loader (43d74e1)

1.26.1

03 Jan 08:43
Compare
Choose a tag to compare

1.26.1 (2025-01-03)

Fix

  • fix: add revision for jinaai/jina-embeddings-v2-small-en (#1692)

add revision (6bfc1f2)

Unknown

  • fix: add trust_remote_code to Snowflake/snowflake-arctic-embed-m-long (#1695)

trust remote code (f4de307)

1.26.0

02 Jan 21:34
Compare
Choose a tag to compare

1.26.0 (2025-01-02)

Feature

  • feat: add avsolatorio/NoInstruct-small-Embedding-v0 (#1677)

add no_instruct (ba1f022)

Fix

  • fix: arg name for openbmb/MiniCPM-Embedding (#1691)

fix name (4a496b9)

1.25.20

02 Jan 09:23
Compare
Choose a tag to compare

1.25.20 (2025-01-02)

Fix

  • fix: nomic tensor return (#1683)

  • fix nomic tensor return

  • add typehint (f5e6401)

1.25.19

02 Jan 08:32
Compare
Choose a tag to compare

1.25.19 (2025-01-02)

Fix

  • fix: trust remote code for snowflake-arctic-embed-m-v2.0 (#1682)

trust remote code (7b1e67b)

1.25.18

02 Jan 04:53
Compare
Choose a tag to compare

1.25.18 (2025-01-02)

Fix

  • fix: add check for key error in loader (#1675)

  • add check for key error

  • make KeyError everywhere

  • update error (1aa08fd)

1.25.17

01 Jan 21:06
Compare
Choose a tag to compare

1.25.17 (2025-01-01)

Fix

  • fix: Add warning for non-retrieval tasks when using bm25s (#1678)

  • clean up install instruction

  • add check for bm25s and skip non-retrieval tasks

  • add versions (c50f26c)