Skip to content

v0.6.0
Compare
Choose a tag to compare
@ssheng ssheng released this 11 Jul 08:29
· 111 commits to main since this release
v0.6.0
This tag was signed with the committer’s verified signature.
aarnphm Aaron Pham
GPG key ID: 18974753009D2BFA
Learn about vigilant mode.
165a593
This commit was signed with the committer’s verified signature.
aarnphm Aaron Pham
GPG key ID: 18974753009D2BFA
Learn about vigilant mode.

We are thrilled to announce the release of OpenLLM 0.6, which marks a significant shift in our project's philosophy. This release introduces breaking changes to the codebase, reflecting our renewed focus on streamlining cloud deployment for LLMs.

In the previous releases, our goal was to provide users with the ability to fully customize their LLM deployment. However, we realized that the customization support in OpenLLM led to scope creep, deviating from our core focus on making LLM deployment simple. With the rise of open source LLMs and the growing emphasis on LLM-focused application development, we have decided to concentrate on what OpenLLM does best - simplifying LLM deployment.

We have completely revamped the architecture to make OpenLLM a tool that simplifies running LLMs as an API endpoint, prioritizing ease of use and performance. This means that 0.6 breaks away from many of the old Python APIs provided in 0.5, emphasizing itself as an easy-to-use CLI tool with cross-platform compatibility for users to deploy open source LLMs.

To learn more about the exciting features and capabilities of OpenLLM, visit our [GitHub](https://github.com/bentoml/OpenLLM) repository. We invite you to explore the new release, provide feedback, and join us in our mission to make cloud deployment of LLMs accessible and efficient for everyone.

Thank you for your continued support and trust in OpenLLM. We look forward to seeing the incredible applications you will build with the tool.

Assets 2
Loading