This repository has been archived by the owner on Jun 9, 2024. It is now read-only.

Support for Petals #227

Open

hythem1979 opened this issue Sep 13, 2023 · 0 comments

Labels

new third party request for plugin

hythem1979 commented Sep 13, 2023

I think it will be useful to add support for petals.dev.
I think it will run faster and work with bigger models like llama 2 70b.

ntindle added request for plugin new third party labels

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.