We welcome contributions such as new datasets to MTEB! This section describes how to set up the repository for development.
If you want to submit a dataset or on other ways contribute to MTEB, you can install the package in development mode:
git clone https://github.com/embeddings-benchmark/mteb
cd mteb
# create your virtual environment and activate it
make install
To run the tests, you can use the following command:
make test
# or if you want to run on multiple cores
make test-parallel
To run the linting before a PR you can use the following command:
make lint