Tool support is finally here! This release adds support exposing tools to LLMs, previously described in the release notes for 0.26a0 and 0.26a1.
Read Large Language Models can run tools in your terminal with LLM 0.26 for a detailed overview of the new features.
Also in this release:
- Two new default tools:
llm_version()
andllm_time()
. #1096, #1103 - Documentation on how to add tool supports to a model plugin. #1000
- Added a prominent warning about the risk of prompt injection when using tools. #1097
- Switched to using monotonic ULIDs for the response IDs in the logs, fixing some intermittent test failures. #1099
- New
tool_instances
table records details of Toolbox instances created while executing a prompt. #1089 llm.get_key()
is now a documented utility function. #1094