Replies: 1 comment
-
Met the same issue, not sure how exactly one is picked over the others |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Since #6588, some GGUFs contain multiple chat templates. For example: https://huggingface.co/bartowski/c4ai-command-r-08-2024-GGUF?show_file_info=c4ai-command-r-08-2024-Q4_K_M.gguf
But if I understand correctly, nothing was ever implemented to actually select one of these additional chat templates, as it wasn't a priority back then.
Now that a lot of work has been done to chat templates and jinja features this year, is it worth while to look at this feature again?
Ideally I would like a new parameter for the cli and server where you can name one of the other chat templates. For example: "--multi-chat-template {name in tokenizer.chat_templates}". Or you could implement this into the existing --chat-template parameter
Beta Was this translation helpful? Give feedback.
All reactions