Skip to content

Issues: ggml-org/llama.cpp

examples : add configuration presets
#10932 opened Dec 21, 2024 by ggerganov
Open 3
changelog : libllama API
#9289 opened Sep 3, 2024 by ggerganov
Open 9
changelog : llama-server REST API
#9291 opened Sep 3, 2024 by ggerganov
Open 14
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

327 Open 4,572 Closed
327 Open 4,572 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Misc. bug: The llama-server not read the "--keep" param that user input in the cli bug-unconfirmed
#12927 opened Apr 13, 2025 by ZUIcat
Feature Request: Support for Apriel-5B-Instruct enhancement New feature or request
#12926 opened Apr 13, 2025 by Abdulhanan535
4 tasks done
Misc. bug: gguf-my-repo doesn't work - [Errno 2] No such file or directory: './llama.cpp/llama-quantize' bug-unconfirmed
#12925 opened Apr 13, 2025 by rnckp
Misc. bug: convert_hf_to_gguf.py: ValueError: Can not map tensor 'model.layers.0.mlp.down_proj.SCB' bug-unconfirmed
#12923 opened Apr 12, 2025 by evgenyigumnov
Compile bug: macro "DECL_FATTN_MMA_F16_CASE" requires 3 arguments, but only 2 given bug-unconfirmed
#12921 opened Apr 12, 2025 by sb98052
2
Misc. bug: llama-bench --tensor-split handling is broken bug-unconfirmed
#12917 opened Apr 12, 2025 by ashirviskas
1
Eval bug: IQ2_M broken for mradermacher / Llama-4-Maverick-17B-128E-Instruct-GGUF bug-unconfirmed
#12913 opened Apr 12, 2025 by whatever1983
1
Misc. bug: LLaVa Projector Possibly Wrong Tensor Order bug-unconfirmed
#12912 opened Apr 12, 2025 by taronaeo
6
Compile bug: how to enable opencl in termux bug-unconfirmed
#12911 opened Apr 12, 2025 by ZJY0516
1
multiple_choice_score : task 17 does not fit in the context window
#12905 opened Apr 11, 2025 by Bobchenyx
1
what *tool/framework* to use if testing performance of .gguf models
#12901 opened Apr 11, 2025 by Bobchenyx
1
Compile bug: FAILED: examples/llava/CMakeFiles/llava.dir/llava.cpp.obj bug-unconfirmed
#12899 opened Apr 11, 2025 by gercamjr
How to use *chat_template* with .gguf models ? (tokenizer_name not implemented)
#12897 opened Apr 11, 2025 by Bobchenyx
Compile bug: cuda backend compile error bug-unconfirmed
#12893 opened Apr 11, 2025 by lizhenneng
Eval bug: add support for https://huggingface.co/ bug-unconfirmed
#12884 opened Apr 10, 2025 by gnusupport
1
Eval bug: moonshotai/Moonlight-16B-A3B-Instruct bug-unconfirmed
#12880 opened Apr 10, 2025 by gnusupport
Eval bug: ROCm error: CUBLAS_STATUS_INTERNAL_ERROR bug-unconfirmed
#12878 opened Apr 10, 2025 by MikeLP
7
Eval bug: Assertion _LIBCPP_ASSERT_VALID_ELEMENT_ACCESS while using a particular model bug-unconfirmed
#12877 opened Apr 10, 2025 by yurivict
Misc. bug: llama fails to run on older x86 hardware. bug-unconfirmed
#12866 opened Apr 10, 2025 by kraxel
1
1
Eval bug: LLaVa convert_image_encoder_to_gguf.py fails to byteswap v.head.ffn_up.bias tensor on Big-Endian system bug-unconfirmed
#12863 opened Apr 10, 2025 by taronaeo
4
Misc. bug: convert_hf_to_gguf.py fails to convert the model of architecture T5ForConditionalGeneration bug-unconfirmed
#12862 opened Apr 10, 2025 by yurivict
Misc. bug: llama-embedding asserts: GGML_ASSERT(params.n_batch >= params.n_ctx); bug-unconfirmed
#12860 opened Apr 10, 2025 by yurivict
CUDA: implementation of mul_mat_id
#12859 opened Apr 10, 2025 by A3shTnT
1
Eval bug: llama_model_load: error loading model: error loading model hyperparameters: key not found in model: llama.context_length bug-unconfirmed
#12857 opened Apr 10, 2025 by www222fff
Eval bug: convert_hf_to_gguf.py AttributeError: bug-unconfirmed
#12847 opened Apr 9, 2025 by xiaoyaojun666
1
ProTip! no:milestone will show everything without a milestone.