Skip to content

Commit 6bc2ae5

Browse files
authored
chore(model gallery): add smolvlm2-2.2b-instruct (#5415)
chore(model gallery): add smolvlm-instruct Signed-off-by: Ettore Di Giacinto <[email protected]>
1 parent 8caaf49 commit 6bc2ae5

File tree

1 file changed

+19
-0
lines changed

1 file changed

+19
-0
lines changed

gallery/index.yaml

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -66,6 +66,25 @@
6666
- filename: mmproj-SmolVLM-Instruct-Q8_0.gguf
6767
sha256: 86b84aa7babf1ab51a6366d973b9d380354e92c105afaa4f172cc76d044da739
6868
uri: https://huggingface.co/ggml-org/SmolVLM-Instruct-GGUF/resolve/main/mmproj-SmolVLM-Instruct-Q8_0.gguf
69+
- !!merge <<: *smolvlm
70+
name: "smolvlm2-2.2b-instruct"
71+
icon: https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/SmolVLM2_banner.png
72+
urls:
73+
- https://huggingface.co/HuggingFaceTB/SmolVLM2-2.2B-Instruct
74+
- https://huggingface.co/ggml-org/SmolVLM2-2.2B-Instruct-GGUF
75+
description: |
76+
SmolVLM2-2.2B is a lightweight multimodal model designed to analyze video content. The model processes videos, images, and text inputs to generate text outputs - whether answering questions about media files, comparing visual content, or transcribing text from images. Despite its compact size, requiring only 5.2GB of GPU RAM for video inference, it delivers robust performance on complex multimodal tasks. This efficiency makes it particularly well-suited for on-device applications where computational resources may be limited.
77+
overrides:
78+
parameters:
79+
model: SmolVLM2-2.2B-Instruct-Q4_K_M.gguf
80+
mmproj: mmproj-SmolVLM2-2.2B-Instruct-Q8_0.gguf
81+
files:
82+
- filename: SmolVLM2-2.2B-Instruct-Q4_K_M.gguf
83+
sha256: 0cf76814555b8665149075b74ab6b5c1d428ea1d3d01c1918c12012e8d7c9f58
84+
uri: huggingface://ggml-org/SmolVLM2-2.2B-Instruct-GGUF/SmolVLM2-2.2B-Instruct-Q4_K_M.gguf
85+
- filename: mmproj-SmolVLM2-2.2B-Instruct-Q8_0.gguf
86+
sha256: ae07ea1facd07dd3230c4483b63e8cda96c6944ad2481f33d531f79e892dd024
87+
uri: huggingface://ggml-org/SmolVLM2-2.2B-Instruct-GGUF/mmproj-SmolVLM2-2.2B-Instruct-Q8_0.gguf
6988
- &qwen3
7089
url: "github:mudler/LocalAI/gallery/qwen3.yaml@master"
7190
name: "qwen3-30b-a3b"

0 commit comments

Comments
 (0)