DeServe Benchmark

Before running the benchmark, take a look at the source code of available options.

Download Datasets

git lfs install
git clone https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered datasets/ShareGPT_Vicuna_unfiltered

python -m src.benchmark.online_vllm

python -m src.benchmark.offline_vllm

Name		Name	Last commit message	Last commit date
Latest commit History 24 Commits
src		src
.gitignore		.gitignore
README.md		README.md
requirements.txt		requirements.txt