v0.1.20

Installation

pip install openllm==0.1.20

To upgrade from a previous version, use the following command:

pip install --upgrade openllm==0.1.20

Usage

All available models: python -m openllm.models

To start a LLM: python -m openllm start dolly-v2

Find more information about this release in the CHANGELOG.md

What's Changed

• fix: running MPT on CPU by @aarnphm in #92
• tests: add sanity check for openllm.client by @aarnphm in #93
• feat: custom dockerfile templates by @aarnphm in #95
• feat(llm): fine-tuning Falcon by @aarnphm in #98
• feat: add citation by @aarnphm in #103
• peft: improve speed and quality by @aarnphm in #102
• chore: fix mpt loading on single GPU by @aarnphm in #105

Full Changelog: v0.1.19...v0.1.20