-
Tool support, compatible with LLM 0.26. #3
First, start a
llama-server
server running with a model that supports tools. This one is a 3.2GB download:brew install llama.cpp llama-server --jinja -hf unsloth/gemma-3-4b-it-GGUF:Q4_K_XL
Then in another window:
llm install llm-llama-server llm -m llama-server-tools -T llm_time 'what time is it?' --td