Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YAML parsing fails with cryptic error "Fatal Error: Failed to parse assistant: models.0: Invalid inputmodels.1: Invalid input" #4962

Open
3 tasks done
sammyvoncheese opened this issue Apr 3, 2025 · 2 comments
Assignees
Labels
area:configuration Relates to configuration options good-first-issue Suggested issue for new contributors ide:vscode Relates specifically to VS Code extension kind:bug Indicates an unexpected problem or unintended behavior priority:medium Indicates medium priority

Comments

@sammyvoncheese
Copy link
Contributor

Before submitting your bug report

Relevant environment info

- OS: Windows 11
- Continue version: 1.1.18
- IDE version: vscode Version: 1.98.2 (user setup)
Commit: ddc367ed5c8936efe395cffeec279b04ffd7db78
Date: 2025-03-12T13:32:45.399Z
Electron: 34.2.0
ElectronBuildId: 11161602
Chromium: 132.0.6834.196
Node.js: 20.18.2
V8: 13.2.152.36-electron.0
OS: Windows_NT x64 10.0.26100
- Model: all
- config:
  : v1
version: 1.0.0


models:

  - name: gemma3:27b
    provider: ollama
    model: gemma3:27b
    apiBase: http://127.0.0.1:11434
    defaultCompletionOptions:
        maxtokens: 4056
        temperature: 0.2
        topP: .2
    capabilities:
      - tools_use
    roles:
      - chat

  - name: qwen2.5:32b
    provider: ollama
    model: qwen2.5:32b
    apiBase: http://127.0.0.1:11434
    defaultCompletionOptions:
        maxtokens: 8000
        temperature: 0.2
        topP: .2
    capabilities:
      - tools_use
    roles:
      - chat
     

  
  OR link to assistant in Continue hub:

Description

After updating to version 1.0.5 I got an error message when loading. I have a large config.yaml which has grown over time, with lots of old/unnecessary or possibly outdated stuff in it. Because of this, every model had tools enabled (I never checked each one to see if they actually supported tools)

Image

The error is caused by values this value in the yaml. In the cases I showed, those 2 models will fail because of
capabilities: - tools_use

Removing that from the yaml will allow it to load.

Here are 2 examples where it fails.

schema: v1
version: 1.0.0

models:

  • name: gemma3:27b
    provider: ollama
    model: gemma3:27b
    apiBase: http://127.0.0.1:11434
    defaultCompletionOptions:
    maxtokens: 4056
    temperature: 0.2
    topP: .2
    capabilities:

    • tools_use
      roles:
    • chat
  • name: qwen2.5:32b
    provider: ollama
    model: qwen2.5:32b
    apiBase: http://127.0.0.1:11434
    defaultCompletionOptions:
    maxtokens: 8000
    temperature: 0.2
    topP: .2
    capabilities:

    • tools_use
      roles:
    • chat
    
    

To reproduce

No response

Log output

@dosubot dosubot bot added area:configuration Relates to configuration options ide:vscode Relates specifically to VS Code extension kind:bug Indicates an unexpected problem or unintended behavior labels Apr 3, 2025
@Patrick-Erichsen Patrick-Erichsen added priority:medium Indicates medium priority good-first-issue Suggested issue for new contributors and removed "needs-triage" labels Apr 3, 2025
@Patrick-Erichsen
Copy link
Collaborator

Patrick-Erichsen commented Apr 3, 2025

Thanks for narrowing this down and letting us know @sammyvoncheese 👍 we could definitely use some better error message naming in our YAML parsing.

Not sure how soon we'll be able to prioritize this, so I added a good first issue label if anyone is interested in picking it up. Relevant code is here: https://github.com/continuedev/continue/tree/main/packages/config-yaml

@sammyvoncheese
Copy link
Contributor Author

I can take a look.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area:configuration Relates to configuration options good-first-issue Suggested issue for new contributors ide:vscode Relates specifically to VS Code extension kind:bug Indicates an unexpected problem or unintended behavior priority:medium Indicates medium priority
Projects
None yet
Development

No branches or pull requests

2 participants