Code

Support vllm quantization#7297

Code

Open

ivanvykopal wants to merge 4 commits intoBerriAI:mainBerriAI/litellm:mainfrom ivanvykopal:vllm-quantizationivanvykopal/litellm:vllm-quantizationCopy head branch name to clipboard

+160-7

Commits

Commits on Dec 18, 2024

• feat: support vllm quantization

  ivanvykopal

  committed
  a78db3d

Commits on Dec 19, 2024

• feat: move default params to VLLMConfig

  ivanvykopal

  committed
  e4fe7e8

• feat: add tests for vllm

  ivanvykopal

  committed
  8049480

Commits on Dec 20, 2024

• Merge branch 'main' into vllm-quantization

  ivanvykopal

  committed
  f1638a3