Skip to content

Issues: ggerganov/llama.cpp

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

350 Open 2,631 Closed
350 Open 2,631 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Segmentation Fault on GPU
#7337 opened May 17, 2024 by djain-fujitsu
Issues: Unable for multiuser prompt
#7336 opened May 17, 2024 by OlivesHere
llava surgery script for new llava-arch model from Intel bug-unconfirmed
#7333 opened May 16, 2024 by KohakuBlueleaf
GGML_ASSERT(n_embd_gqa == n_embd_k_gqa) fails in models where key vector dimension is different from value vector dimension
#7331 opened May 16, 2024 by fairydreaming
Support Falcon2-11B enhancement New feature or request
#7318 opened May 16, 2024 by reneleonhardt
4 tasks done
1
ggml_validate_row_data finding nan value for IQ4_NL bug-unconfirmed
#7311 opened May 15, 2024 by bartowski1182
1
2
Add support for multilingual Viking models, please. enhancement New feature or request
#7309 opened May 15, 2024 by JohnClaw
1
Possible performance boost with 2-pass online softmax bug-unconfirmed
#7306 opened May 15, 2024 by zixuanweeei
relocation R_X86_64_32 against hidden symbol `__TMC_END__' can not be used when making a shared object bug-unconfirmed
#7301 opened May 15, 2024 by asarubbo
How to quantize fine-tune LLM into GGUF format
#7299 opened May 15, 2024 by dibyendubiswas1998
2
Improve and expand Wikipedia article about llama.cpp enhancement New feature or request
#7294 opened May 15, 2024 by fffelix-jan
4 tasks done
1
RPC issues and comments bug-unconfirmed
#7293 opened May 15, 2024 by steampunque
@rgerganov
7
enable rpc for server enhancement New feature or request
#7292 opened May 15, 2024 by steampunque
@rgerganov
Llama-3 Instruct tokenizer_config.json changes in relation to the currently fetched llama-bpe configs. enhancement New feature or request
#7289 opened May 14, 2024 by Spacellary
4 tasks done
Infinite update_slots issue on latest build (1265c67) bug-unconfirmed
#7283 opened May 14, 2024 by Leowolf93
/embeddings endpoint sometimes does not return embedding bug-unconfirmed
#7277 opened May 14, 2024 by marcingomulkiewicz
ThunderKittens：a simple yet faster flashattention alternative enhancement New feature or request
#7276 opened May 14, 2024 by sorasoras
1
Windows MSYS2 compilation error. [SOLVED]
#7275 opened May 14, 2024 by Zibri
3
EOT token incorrectly set for Mistral-v0.2 trained with added ChatML tokens bug-unconfirmed
#7271 opened May 14, 2024 by xzuyn
2
Does it make sense to optimize strlen in this function with for loops? bug-unconfirmed
#7268 opened May 13, 2024 by GermanAizek
4
Metal (iOS): Compute function exceeds available temporary registers bug-unconfirmed
#7261 opened May 13, 2024 by guinmoon
MPI issue on raspberry pi cluster bug-unconfirmed
#7260 opened May 13, 2024 by zhouwul
3
while finetuning llama.cpp doesn't create .bin file... bug-unconfirmed
#7253 opened May 13, 2024 by elijiahmiro
llama : save downloaded models to local cache enhancement New feature or request examples good first issue Good for newcomers
#7252 opened May 13, 2024 by ggerganov
2
How to build the llamacpp's .so file separately and then pass it in the llama_cpp_python / wrapper libraries directly.
#7250 opened May 13, 2024 by fastdaima
1
ProTip! Type g i on any issue or pull request to go back to the issue listing page.