-
-
Notifications
You must be signed in to change notification settings - Fork 849
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
"Aborted" after Offline Model download #933
Comments
How much RAM/VRAM does your machine have? This seems like Khoj has run out of memory and crashed. Can you also try use one of the smaller (2B, 3B) default models like Gemma-2 2B to see if you can get a response from Khoj using them? You would need to update your ServerChatSettings in the Khoj admin panel at localhost:42110/server/admin |
I tested the bartowski/gemma-2-2b-it-GGUF Model but with the same Abort message. |
I see, that does sound strange. 12Gb RAM should be enough for Khoj to work (though without GPU it'd be slow) Did you switch the chat model to Gemma 2 2B in both the Khoj Admin panel at http://localhost:42110/server/admin/database/serverchatsettings/ and your user settings at http://localhost:42110/settings? Just want to make sure that this is happening even when a single small chat model is being used by Khoj |
Yeah, i changed the settings in both. It is an GPU Installation for a AMD RX6900XT with 16GB VRAM. |
I see, good to know. Not sure what's up. You have a decent sized GPU. What command did you use to install Khoj with GPU support?
|
I tried the first step, but everything looks alright.
i will now try the second step. |
I am using an Ubuntu VM and apparently my GPU never reached the VM. I guess that this is the problem. I try to fix this and will post here later. |
Describe the bug
When i add a new offline ,odel and start the chat with any input., i can see that khoj starts to download the model in the console. but after it finished downloading the model, khoj crashes with nothing more than "Aborted (core dumped)". I used the -vv as start-parameter but i dont get any more information.
To Reproduce
i used 2 own offline models and the one that is preinstalled. Nothign worked.
Screenshots
Platform
If self-hosted
Additional context
Where can i get more information?
The text was updated successfully, but these errors were encountered: