-
Notifications
You must be signed in to change notification settings - Fork 340
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Identity Adapter #566
Comments
This issue has been automatically marked as stale because it has been without activity for 90 days. This issue will be closed in 14 days unless you comment or remove the stale label. |
This issue was closed because it was stale for 14 days without any activity. |
Sorry for not responding to this issue! Passing Re-opening as feature requests. Open for PR, otherwise we'll look into it :) |
I am exploring a personalisation model that has one adapter per user. When there's enough data for a given user, an adapter is trained for that user, otherwise the default model weights are used (no adapters).
The problem is inference with Parallel. A batch contains samples from multiple users, some have adapters and some don't. However, it's not possible to extract default model weights with Parallel, eg. by using
None
adapter.What is the best way to achieve this? I'm thinking of making a PR with an Identity Adapter.
Thanks!
The text was updated successfully, but these errors were encountered: