Provided model name is ignored when using TGI #4968
Labels
area:autocomplete
Relates to the auto complete feature
ide:vscode
Relates specifically to VS Code extension
kind:bug
Indicates an unexpected problem or unintended behavior
"needs-triage"
priority:medium
Indicates medium priority
Before submitting your bug report
Relevant environment info
Description
I host the model using huggingface tgi on a server under a specific name which did not include the "coder" in qwen.
I noticed that the wrong fim template was used, although I specified the model name in my config. While debugging into the extension, I noticed that the model name was overwritten with the abstract name I used to host the model.
Further, I noticed that this does not happen in the sandbox environment, but only when I open a new folder in the extension development host vscode window. My user config is as the same as the debug config.
I guess this could be called a feature, but from my perspective it is unexpected behavior.
Maybe a flag like "infereModelName" could be added, but by default the provided model name should be used.
To reproduce
lowerCaseModel
ingetTemplateForModel
inAutocompleteTemplate.ts
.Log output
The text was updated successfully, but these errors were encountered: