Skip to content
Compare
Choose a tag to compare
@simonw simonw released this 28 May 06:19
· 1 commit to main since this release
  • Tool support, compatible with LLM 0.26. #3

    First, start a llama-server server running with a model that supports tools. This one is a 3.2GB download:

    brew install llama.cpp
    llama-server --jinja -hf unsloth/gemma-3-4b-it-GGUF:Q4_K_XL

    Then in another window:

    llm install llm-llama-server
    llm -m llama-server-tools -T llm_time 'what time is it?' --td