gemma3n unable to run ipex-llm

[shailesh837]

Please can you let me know if we can run ipex-llm with gemma3n

gemma3n

[rnwang04]

Hi @shailesh837 , gemma3n is supported from ipex-llm[cpp]==2.3.0b20250630.
You could try it first with pip install --pre --upgrade ipex-llm[cpp] or waiting for new ollama portable zip, we will release it recently.

[rnwang04]

Hi @shailesh837 , new portable zip is uploaded here: https://github.com/ipex-llm/ipex-llm/releases/download/v2.3.0-nightly/ollama-ipex-llm-2.3.0b20250630-win.zip , and in this new portable zip, you can run with gemma3n.

[savvadesogle]

Hi @shailesh837 , new portable zip is uploaded here: https://github.com/ipex-llm/ipex-llm/releases/download/v2.3.0-nightly/ollama-ipex-llm-2.3.0b20250630-win.zip , and in this new portable zip, you can run with gemma3n.

Hello, not working with portable (2.3.0b20250630-win) or installed ipex-llm[cpp] (conda env)

model: gemma3n:latest 15cb39fd9394 7.5 GB (gemma3n:e4b-it-q4_K_M

And here is some bug fixes im main ollama for gemma3n: ollama/ollama@v0.9.3...v0.9.4 (convert/convert_gemma3n.go)
log:

C:\llm\llama-cpp\2.3.0b20250630>ollama serve
time=2025-07-02T11:36:28.640+03:00 level=INFO source=routes.go:1235 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\uuk\\.ollama\\models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES:]"
time=2025-07-02T11:36:28.702+03:00 level=INFO source=images.go:476 msg="total blobs: 11"
time=2025-07-02T11:36:28.704+03:00 level=INFO source=images.go:483 msg="total unused blobs removed: 0"
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
 - using env:   export GIN_MODE=release
 - using code:  gin.SetMode(gin.ReleaseMode)

[GIN-debug] HEAD   /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] GET    /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
[GIN-debug] HEAD   /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func3 (5 handlers)
[GIN-debug] GET    /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func4 (5 handlers)
[GIN-debug] POST   /api/pull                 --> github.com/ollama/ollama/server.(*Server).PullHandler-fm (5 handlers)
[GIN-debug] POST   /api/push                 --> github.com/ollama/ollama/server.(*Server).PushHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] GET    /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] POST   /api/show                 --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (5 handlers)
[GIN-debug] DELETE /api/delete               --> github.com/ollama/ollama/server.(*Server).DeleteHandler-fm (5 handlers)[GIN-debug] POST   /api/create               --> github.com/ollama/ollama/server.(*Server).CreateHandler-fm (5 handlers)[GIN-debug] POST   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).CreateBlobHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).HeadBlobHandler-fm (5 handlers)
[GIN-debug] POST   /api/copy                 --> github.com/ollama/ollama/server.(*Server).CopyHandler-fm (5 handlers)
[GIN-debug] GET    /api/ps                   --> github.com/ollama/ollama/server.(*Server).PsHandler-fm (5 handlers)
[GIN-debug] POST   /api/generate             --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (5 handlers)
[GIN-debug] POST   /api/chat                 --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (5 handlers)
[GIN-debug] POST   /api/embed                --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (5 handlers)
[GIN-debug] POST   /api/embeddings           --> github.com/ollama/ollama/server.(*Server).EmbeddingsHandler-fm (5 handlers)
[GIN-debug] POST   /v1/chat/completions      --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (6 handlers)
[GIN-debug] POST   /v1/completions           --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (6 handlers)
[GIN-debug] POST   /v1/embeddings            --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models                --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models/:model         --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (6 handlers)
time=2025-07-02T11:36:28.737+03:00 level=INFO source=routes.go:1288 msg="Listening on 127.0.0.1:11434 (version 0.9.3)"
time=2025-07-02T11:36:28.738+03:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
time=2025-07-02T11:36:28.742+03:00 level=INFO source=gpu.go:218 msg="using Intel GPU"
time=2025-07-02T11:36:28.743+03:00 level=INFO source=gpu_windows.go:167 msg=packages count=2
time=2025-07-02T11:36:28.744+03:00 level=INFO source=gpu_windows.go:214 msg="" package=0 cores=18 efficiency=0 threads=36
time=2025-07-02T11:36:28.745+03:00 level=INFO source=gpu_windows.go:214 msg="" package=1 cores=18 efficiency=0 threads=36
time=2025-07-02T11:36:28.774+03:00 level=INFO source=types.go:130 msg="inference compute" id=0 library=cpu variant="" compute="" driver=0.0 name="" total="127.9 GiB" available="116.0 GiB"
[GIN] 2025/07/02 - 11:36:58 | 200 |       503.4µs |       127.0.0.1 | HEAD     "/"
[GIN] 2025/07/02 - 11:36:58 | 200 |      7.0101ms |       127.0.0.1 | GET      "/api/tags"
[GIN] 2025/07/02 - 11:37:07 | 200 |            0s |       127.0.0.1 | HEAD     "/"
[GIN] 2025/07/02 - 11:37:07 | 200 |    290.2304ms |       127.0.0.1 | POST     "/api/show"
time=2025-07-02T11:37:08.381+03:00 level=INFO source=server.go:135 msg="system memory" total="127.9 GiB" free="116.0 GiB" free_swap="122.1 GiB"
time=2025-07-02T11:37:08.383+03:00 level=INFO source=server.go:187 msg=offload library=cpu layers.requested=-1 layers.model=36 layers.offload=0 layers.split="" memory.available="[116.0 GiB]" memory.gpu_overhead="0 B" memory.required.full="5.0 GiB" memory.required.partial="0 B" memory.required.kv="280.0 MiB" memory.required.allocations="[5.0 GiB]" memory.weights.total="2.6 GiB" memory.weights.repeating="2.2 GiB" memory.weights.nonrepeating="420.4 MiB" memory.graph.full="2.0 GiB" memory.graph.partial="3.7 GiB"
time=2025-07-02T11:37:08.531+03:00 level=INFO source=server.go:458 msg="starting llama server" cmd="C:\\llm\\llama-cpp\\2.3.0b20250630\\ollama-lib.exe runner --ollama-engine --model C:\\Users\\uuk\\.ollama\\models\\blobs\\sha256-38e8dcc30df4eb0e29eaf5c74ba6ce3f2cd66badad50768fc14362acfb8b8cb6 --ctx-size 4096 --batch-size 512 --n-gpu-layers 999 --threads 36 --no-mmap --parallel 2 --port 54345"
time=2025-07-02T11:37:08.534+03:00 level=INFO source=sched.go:483 msg="loaded runners" count=1
time=2025-07-02T11:37:08.535+03:00 level=INFO source=server.go:618 msg="waiting for llama runner to start responding"
time=2025-07-02T11:37:08.537+03:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server error"
time=2025-07-02T11:37:08.668+03:00 level=INFO source=runner.go:925 msg="starting ollama engine"
time=2025-07-02T11:37:08.713+03:00 level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:54345"
time=2025-07-02T11:37:08.789+03:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server loading model"
time=2025-07-02T11:37:08.869+03:00 level=INFO source=ggml.go:96 msg="" architecture=gemma3n file_type=Q4_K_M name="" description="" num_tensors=847 num_key_values=40
time=2025-07-02T11:37:08.877+03:00 level=INFO source=ggml.go:104 msg=system CPU.0.LLAMAFILE=1 compiler=cgo(clang)
Running with Environment Variables:
  GGML_SYCL_DEBUG: 0
  GGML_SYCL_DISABLE_OPT: 1
  GGML_SYCL_DISABLE_GRAPH: 1
  GGML_SYCL_PRIORITIZE_DMMV: 0
Build with Macros:
  GGML_SYCL_FORCE_MMQ: no
  GGML_SYCL_F16: no
Found 1 SYCL devices:
|  |                   |                                       |       |Max    |        |Max  |Global |                     |
|  |                   |                                       |       |compute|Max work|sub  |mem    |                     |
|ID|        Device Type|                                   Name|Version|units  |group   |group|size   |       Driver version|
|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
| 0| [level_zero:gpu:0]|                Intel Arc A770 Graphics|  12.55|    512|    1024|   32| 16704M|            1.6.33511|
SYCL Optimization Feature:
|ID|        Device Type|Reorder|
|--|-------------------|-------|
| 0| [level_zero:gpu:0]|      Y|
ggml_backend_sycl_buffer_type_alloc_buffer: can't allocate 402653184 Bytes of memory on device
alloc_tensor_range: failed to allocate SYCL0 buffer of size 4697620480
panic: insufficient memory - required allocations: {InputWeights:440832000A CPU:{Name:CPU UUID: Weights:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Cache:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Graph:0U} GPUs:[{Name:SYCL0 UUID: Weights:[72269184F 72269184F 72269184F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 72269184F 72269184F 72269184F 72269184F 5162939392F] Cache:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Graph:0U}]}

goroutine 52 [running]:
github.com/ollama/ollama/ml/backend/ggml.New({0xc000038150, 0x69}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend/ggml/ggml.go:380 +0x3116
github.com/ollama/ollama/ml.NewBackend({0xc000038150, 0x69}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend.go:209 +0xb1
github.com/ollama/ollama/model.New({0xc000038150?, 0x0?}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/model/model.go:102 +0x8f
github.com/ollama/ollama/runner/ollamarunner.(*Server).initModel(0xc00051c000, {0xc000038150?, 0x0?}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0}, ...)
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:841 +0x8d
github.com/ollama/ollama/runner/ollamarunner.(*Server).load(0xc00051c000, {0x7ff7df78c9d0, 0xc000194af0}, {0xc000038150?, 0x0?}, {0x24, 0x0, 0x3e7, {0x0, 0x0, ...}, ...}, ...)
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:878 +0xb8
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:959 +0xa11
time=2025-07-02T11:37:12.052+03:00 level=ERROR source=sched.go:489 msg="error loading llama server" error="llama runner process has terminated: exit status 2"
[GIN] 2025/07/02 - 11:37:12 | 500 |    4.1449975s |       127.0.0.1 | POST     "/api/generate"

[shailesh837]

@rnwang04 : Please can you test it and which iGPU and dGPU combination i can suggest to our EMEA customer

[yizhangliu]

When “ollama run gemma3n:e4b“ in [ollama-ipex-llm-2.3.0b20250630]， I got：
Error: llama runner process has terminated: exit status 2

[FilipLaurentiu]

Hi @shailesh837 , new portable zip is uploaded here: https://github.com/ipex-llm/ipex-llm/releases/download/v2.3.0-nightly/ollama-ipex-llm-2.3.0b20250630-win.zip , and in this new portable zip, you can run with gemma3n.

what is the more commanded version, the nightly release or the docker container ? I tried gemma3n with the latest docker container and it doesn't work

[rnwang04]

what is the more commanded version, the nightly release or the docker container ? I tried gemma3n with the latest docker container and it doesn't work

Hi @FilipLaurentiu , we recommend to install the latest portable zip (https://github.com/ipex-llm/ipex-llm/releases/download/v2.3.0-nightly/ollama-ipex-llm-2.3.0b20250630-win.zip / https://github.com/ipex-llm/ipex-llm/releases/download/v2.3.0-nightly/ollama-ipex-llm-2.3.0b20250630-ubuntu.tgz).
You could try it again with it.

[rnwang04]

When “ollama run gemma3n:e4b“ in [ollama-ipex-llm-2.3.0b20250630]， I got： Error: llama runner process has terminated: exit status 2

Hi @yizhangliu , could you please provide us with detailed server log ? On my side, I can run gemma3n:e4b successfully.

arda@arda-arc:~/ollama-ipex-llm-2.3.0b20250630-ubuntu$ ./ollama run gemma3n:e4b
>>> hi
Hi there! 👋 

How can I help you today?  I'm ready for anything - questions, stories, brainstorming, or just a friendly chat. 😊 

Let me know what's on your mind!

[rnwang04]

Hi @savvadesogle , I didn't reproduce the error on my Linux machine, on my side, gemma3n:e4b / gemma3n:e2b both works with latest ollama portable zip, and based on my observation, gemma3n:e4b costs about 8G GPU memory.
Below is my log:

time=2025-07-02T17:42:43.638+08:00 level=INFO source=server.go:135 msg="system memory" total="62.6 GiB" free="50.8 GiB" free_swap="7.9 GiB"
time=2025-07-02T17:42:43.638+08:00 level=INFO source=server.go:187 msg=offload library=cpu layers.requested=-1 layers.model=36 layers.offload=0 layers.split="" memory.available="[50.8 GiB]" memory.gpu_overhead="0 B" memory.required.full="5.0 GiB" memory.required.partial="0 B" memory.required.kv="280.0 MiB" memory.required.allocations="[5.0 GiB]" memory.weights.total="2.6 GiB" memory.weights.repeating="2.2 GiB" memory.weights.nonrepeating="420.4 MiB" memory.graph.full="2.0 GiB" memory.graph.partial="3.7 GiB"
time=2025-07-02T17:42:43.671+08:00 level=INFO source=server.go:458 msg="starting llama server" cmd="/home/arda/ruonan/ollama-ipex-llm-2.3.0b20250630-ubuntu/ollama-bin runner --ollama-engine --model /home/arda/.ollama/models/blobs/sha256-38e8dcc30df4eb0e29eaf5c74ba6ce3f2cd66badad50768fc14362acfb8b8cb6 --ctx-size 4096 --batch-size 512 --n-gpu-layers 999 --threads 8 --no-mmap --parallel 2 --port 46637"
time=2025-07-02T17:42:43.672+08:00 level=INFO source=sched.go:483 msg="loaded runners" count=1
time=2025-07-02T17:42:43.672+08:00 level=INFO source=server.go:618 msg="waiting for llama runner to start responding"
time=2025-07-02T17:42:43.672+08:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server not responding"
time=2025-07-02T17:42:43.696+08:00 level=INFO source=runner.go:925 msg="starting ollama engine"
time=2025-07-02T17:42:43.696+08:00 level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:46637"
time=2025-07-02T17:42:43.731+08:00 level=INFO source=ggml.go:96 msg="" architecture=gemma3n file_type=Q4_K_M name="" description="" num_tensors=847 num_key_values=40
load_backend: loaded SYCL backend from /home/arda/ruonan/ollama-ipex-llm-2.3.0b20250630-ubuntu/libggml-sycl.so
load_backend: loaded CPU backend from /home/arda/ruonan/ollama-ipex-llm-2.3.0b20250630-ubuntu/libggml-cpu-alderlake.so
time=2025-07-02T17:42:43.757+08:00 level=INFO source=ggml.go:104 msg=system CPU.0.LLAMAFILE=1 CPU.0.OPENMP=1 CPU.0.AARCH64_REPACK=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc)
Running with Environment Variables:
  GGML_SYCL_DEBUG: 0
  GGML_SYCL_DISABLE_OPT: 1
  GGML_SYCL_DISABLE_GRAPH: 1
  GGML_SYCL_PRIORITIZE_DMMV: 0
Build with Macros:
  GGML_SYCL_FORCE_MMQ: no
  GGML_SYCL_F16: no
Found 1 SYCL devices:
|  |                   |                                       |       |Max    |        |Max  |Global |                     |
|  |                   |                                       |       |compute|Max work|sub  |mem    |                     |
|ID|        Device Type|                                   Name|Version|units  |group   |group|size   |       Driver version|
|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
| 0| [level_zero:gpu:0]|                Intel Arc A770 Graphics|  12.55|    512|    1024|   32| 16704M|            1.6.33511|
SYCL Optimization Feature:
|ID|        Device Type|Reorder|
|--|-------------------|-------|
| 0| [level_zero:gpu:0]|      Y|
time=2025-07-02T17:42:43.839+08:00 level=INFO source=ggml.go:388 msg="model weights" buffer=SYCL0 size="7.0 GiB"
time=2025-07-02T17:42:43.839+08:00 level=INFO source=ggml.go:388 msg="model weights" buffer=CPU size="420.4 MiB"
time=2025-07-02T17:42:43.839+08:00 level=INFO source=ggml.go:417 msg="Sycl device count" count=1
time=2025-07-02T17:42:43.854+08:00 level=INFO source=ggml.go:710 msg="compute graph" backend=SYCL0 buffer_type=SYCL0 size="201.7 MiB"
time=2025-07-02T17:42:43.854+08:00 level=INFO source=ggml.go:710 msg="compute graph" backend=SYCL0 buffer_type=SYCL0 size="0 B"
time=2025-07-02T17:42:43.854+08:00 level=INFO source=ggml.go:710 msg="compute graph" backend=CPU buffer_type=CPU size="1.4 GiB"
time=2025-07-02T17:42:43.923+08:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server loading model"
time=2025-07-02T17:42:47.438+08:00 level=INFO source=server.go:657 msg="llama runner started in 3.77 seconds"
[GIN] 2025/07/02 - 17:42:47 | 200 |  3.899137611s |       127.0.0.1 | POST     "/api/generate"
[GIN] 2025/07/02 - 17:42:51 | 200 |  1.659758203s |       127.0.0.1 | POST     "/api/chat"

Could you please have a double check at your side, esp. your GPU memory usage ?

[savvadesogle]

your GPU memory usage ?

What did you mean?

i download and tried it again.. not working. (Windows 11, ollama version is 0.9.3, ollama-ipex-llm-2.3.0b20250630-win.zip)

C:\test>ollama serve
time=2025-07-02T13:49:08.063+03:00 level=INFO source=routes.go:1235 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:C:\\Users\\uuk\\.ollama\\models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES:]"
time=2025-07-02T13:49:08.103+03:00 level=INFO source=images.go:476 msg="total blobs: 11"
time=2025-07-02T13:49:08.104+03:00 level=INFO source=images.go:483 msg="total unused blobs removed: 0"
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
 - using env:   export GIN_MODE=release
 - using code:  gin.SetMode(gin.ReleaseMode)

[GIN-debug] HEAD   /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] GET    /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
[GIN-debug] HEAD   /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func3 (5 handlers)
[GIN-debug] GET    /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func4 (5 handlers)
[GIN-debug] POST   /api/pull                 --> github.com/ollama/ollama/server.(*Server).PullHandler-fm (5 handlers)
[GIN-debug] POST   /api/push                 --> github.com/ollama/ollama/server.(*Server).PushHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] GET    /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] POST   /api/show                 --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (5 handlers)
[GIN-debug] DELETE /api/delete               --> github.com/ollama/ollama/server.(*Server).DeleteHandler-fm (5 handlers)
[GIN-debug] POST   /api/create               --> github.com/ollama/ollama/server.(*Server).CreateHandler-fm (5 handlers)
[GIN-debug] POST   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).CreateBlobHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).HeadBlobHandler-fm (5 handlers)
[GIN-debug] POST   /api/copy                 --> github.com/ollama/ollama/server.(*Server).CopyHandler-fm (5 handlers)
[GIN-debug] GET    /api/ps                   --> github.com/ollama/ollama/server.(*Server).PsHandler-fm (5 handlers)
[GIN-debug] POST   /api/generate             --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (5 handlers)
[GIN-debug] POST   /api/chat                 --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (5 handlers)
[GIN-debug] POST   /api/embed                --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (5 handlers)
[GIN-debug] POST   /api/embeddings           --> github.com/ollama/ollama/server.(*Server).EmbeddingsHandler-fm (5 handlers)
[GIN-debug] POST   /v1/chat/completions      --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (6 handlers)
[GIN-debug] POST   /v1/completions           --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (6 handlers)
[GIN-debug] POST   /v1/embeddings            --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models                --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models/:model         --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (6 handlers)
time=2025-07-02T13:49:08.133+03:00 level=INFO source=routes.go:1288 msg="Listening on 127.0.0.1:11434 (version 0.9.3)"
time=2025-07-02T13:49:08.133+03:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
time=2025-07-02T13:49:08.134+03:00 level=INFO source=gpu.go:218 msg="using Intel GPU"
time=2025-07-02T13:49:08.135+03:00 level=INFO source=gpu_windows.go:167 msg=packages count=2
time=2025-07-02T13:49:08.135+03:00 level=INFO source=gpu_windows.go:214 msg="" package=0 cores=18 efficiency=0 threads=36
time=2025-07-02T13:49:08.136+03:00 level=INFO source=gpu_windows.go:214 msg="" package=1 cores=18 efficiency=0 threads=36
time=2025-07-02T13:49:08.154+03:00 level=INFO source=types.go:130 msg="inference compute" id=0 library=cpu variant="" compute="" driver=0.0 name="" total="127.9 GiB" available="114.3 GiB"
[GIN] 2025/07/02 - 13:49:12 | 200 |       499.2µs |       127.0.0.1 | HEAD     "/"
[GIN] 2025/07/02 - 13:49:12 | 200 |     301.541ms |       127.0.0.1 | POST     "/api/show"
time=2025-07-02T13:49:12.893+03:00 level=INFO source=server.go:135 msg="system memory" total="127.9 GiB" free="114.2 GiB" free_swap="119.9 GiB"
time=2025-07-02T13:49:12.895+03:00 level=INFO source=server.go:187 msg=offload library=cpu layers.requested=-1 layers.model=36 layers.offload=0 layers.split="" memory.available="[114.2 GiB]" memory.gpu_overhead="0 B" memory.required.full="5.0 GiB" memory.required.partial="0 B" memory.required.kv="280.0 MiB" memory.required.allocations="[5.0 GiB]" memory.weights.total="2.6 GiB" memory.weights.repeating="2.2 GiB" memory.weights.nonrepeating="420.4 MiB" memory.graph.full="2.0 GiB" memory.graph.partial="3.7 GiB"
time=2025-07-02T13:49:13.063+03:00 level=INFO source=server.go:458 msg="starting llama server" cmd="C:\\test\\ollama-lib.exe runner --ollama-engine --model C:\\Users\\uuk\\.ollama\\models\\blobs\\sha256-38e8dcc30df4eb0e29eaf5c74ba6ce3f2cd66badad50768fc14362acfb8b8cb6 --ctx-size 4096 --batch-size 512 --n-gpu-layers 999 --threads 36 --no-mmap --parallel 2 --port 54049"
time=2025-07-02T13:49:13.066+03:00 level=INFO source=sched.go:483 msg="loaded runners" count=1
time=2025-07-02T13:49:13.067+03:00 level=INFO source=server.go:618 msg="waiting for llama runner to start responding"
time=2025-07-02T13:49:13.068+03:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server error"
time=2025-07-02T13:49:13.190+03:00 level=INFO source=runner.go:925 msg="starting ollama engine"
time=2025-07-02T13:49:13.227+03:00 level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:54049"
time=2025-07-02T13:49:13.322+03:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server loading model"
time=2025-07-02T13:49:13.538+03:00 level=INFO source=ggml.go:96 msg="" architecture=gemma3n file_type=Q4_K_M name="" description="" num_tensors=847 num_key_values=40
time=2025-07-02T13:49:13.553+03:00 level=INFO source=ggml.go:104 msg=system CPU.0.LLAMAFILE=1 compiler=cgo(clang)
Running with Environment Variables:
  GGML_SYCL_DEBUG: 0
  GGML_SYCL_DISABLE_OPT: 1
  GGML_SYCL_DISABLE_GRAPH: 1
  GGML_SYCL_PRIORITIZE_DMMV: 0
Build with Macros:
  GGML_SYCL_FORCE_MMQ: no
  GGML_SYCL_F16: no
Found 4 SYCL devices:
|  |                   |                                       |       |Max    |        |Max  |Global |                     |
|  |                   |                                       |       |compute|Max work|sub  |mem    |                     |
|ID|        Device Type|                                   Name|Version|units  |group   |group|size   |       Driver version|
|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
| 0| [level_zero:gpu:0]|                Intel Arc A770 Graphics|  12.55|    512|    1024|   32| 16704M|            1.6.33511|
| 1| [level_zero:gpu:1]|                Intel Arc A770 Graphics|  12.55|    512|    1024|   32| 16704M|            1.6.33511|
| 2| [level_zero:gpu:2]|                Intel Arc A770 Graphics|  12.55|    512|    1024|   32| 16704M|            1.6.33511|
| 3| [level_zero:gpu:3]|                Intel Arc A770 Graphics|  12.55|    512|    1024|   32| 16704M|            1.6.33511|
SYCL Optimization Feature:
|ID|        Device Type|Reorder|
|--|-------------------|-------|
| 0| [level_zero:gpu:0]|      Y|
| 1| [level_zero:gpu:1]|      Y|
| 2| [level_zero:gpu:2]|      Y|
| 3| [level_zero:gpu:3]|      Y|
ggml_backend_sycl_buffer_type_alloc_buffer: can't allocate 402653184 Bytes of memory on device
alloc_tensor_range: failed to allocate SYCL0 buffer of size 4697620480
panic: insufficient memory - required allocations: {InputWeights:440832000A CPU:{Name:CPU UUID: Weights:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Cache:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Graph:0U} GPUs:[{Name:SYCL0 UUID: Weights:[72269184F 72269184F 72269184F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 72269184F 72269184F 72269184F 72269184F 5162939392F] Cache:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Graph:0U}]}

goroutine 66 [running]:
github.com/ollama/ollama/ml/backend/ggml.New({0xc000038150, 0x69}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend/ggml/ggml.go:380 +0x3116
github.com/ollama/ollama/ml.NewBackend({0xc000038150, 0x69}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend.go:209 +0xb1
github.com/ollama/ollama/model.New({0xc000038150?, 0x0?}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/model/model.go:102 +0x8f
github.com/ollama/ollama/runner/ollamarunner.(*Server).initModel(0xc00004c120, {0xc000038150?, 0x0?}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0}, ...)
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:841 +0x8d
github.com/ollama/ollama/runner/ollamarunner.(*Server).load(0xc00004c120, {0x7ff642d7c9d0, 0xc000192af0}, {0xc000038150?, 0x0?}, {0x24, 0x0, 0x3e7, {0x0, 0x0, ...}, ...}, ...)
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:878 +0xb8
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
        D:/actions-runner/release-cpp-oneapi_2024_2/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:959 +0xa11
time=2025-07-02T13:49:17.340+03:00 level=ERROR source=sched.go:489 msg="error loading llama server" error="llama runner process has terminated: exit status 2"
[GIN] 2025/07/02 - 13:49:17 | 500 |    4.9278679s |       127.0.0.1 | POST     "/api/generate"

[FilipLaurentiu]

what is the more commanded version, the nightly release or the docker container ? I tried gemma3n with the latest docker container and it doesn't work

Hi @FilipLaurentiu , we recommend to install the latest portable zip (https://github.com/ipex-llm/ipex-llm/releases/download/v2.3.0-nightly/ollama-ipex-llm-2.3.0b20250630-win.zip / https://github.com/ipex-llm/ipex-llm/releases/download/v2.3.0-nightly/ollama-ipex-llm-2.3.0b20250630-ubuntu.tgz). You could try it again with it.

ollama-ipex-llm-2.3.0b20250630-ubuntu ./start-ollama.sh
time=2025-07-02T17:01:39.402+03:00 level=INFO source=routes.go:1235 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:10m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/filip/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:localhost,127.0.0.1]"
time=2025-07-02T17:01:39.402+03:00 level=INFO source=images.go:476 msg="total blobs: 23"
time=2025-07-02T17:01:39.403+03:00 level=INFO source=images.go:483 msg="total unused blobs removed: 0"
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
 - using env:	export GIN_MODE=release
 - using code:	gin.SetMode(gin.ReleaseMode)

[GIN-debug] HEAD   /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] GET    /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
[GIN-debug] HEAD   /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func3 (5 handlers)
[GIN-debug] GET    /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func4 (5 handlers)
[GIN-debug] POST   /api/pull                 --> github.com/ollama/ollama/server.(*Server).PullHandler-fm (5 handlers)
[GIN-debug] POST   /api/push                 --> github.com/ollama/ollama/server.(*Server).PushHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] GET    /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] POST   /api/show                 --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (5 handlers)
[GIN-debug] DELETE /api/delete               --> github.com/ollama/ollama/server.(*Server).DeleteHandler-fm (5 handlers)
[GIN-debug] POST   /api/create               --> github.com/ollama/ollama/server.(*Server).CreateHandler-fm (5 handlers)
[GIN-debug] POST   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).CreateBlobHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).HeadBlobHandler-fm (5 handlers)
[GIN-debug] POST   /api/copy                 --> github.com/ollama/ollama/server.(*Server).CopyHandler-fm (5 handlers)
[GIN-debug] GET    /api/ps                   --> github.com/ollama/ollama/server.(*Server).PsHandler-fm (5 handlers)
[GIN-debug] POST   /api/generate             --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (5 handlers)
[GIN-debug] POST   /api/chat                 --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (5 handlers)
[GIN-debug] POST   /api/embed                --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (5 handlers)
[GIN-debug] POST   /api/embeddings           --> github.com/ollama/ollama/server.(*Server).EmbeddingsHandler-fm (5 handlers)
[GIN-debug] POST   /v1/chat/completions      --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (6 handlers)
[GIN-debug] POST   /v1/completions           --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (6 handlers)
[GIN-debug] POST   /v1/embeddings            --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models                --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models/:model         --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (6 handlers)
time=2025-07-02T17:01:39.403+03:00 level=INFO source=routes.go:1288 msg="Listening on 127.0.0.1:11434 (version 0.9.3)"
time=2025-07-02T17:01:39.403+03:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
time=2025-07-02T17:01:39.403+03:00 level=INFO source=gpu.go:218 msg="using Intel GPU"
time=2025-07-02T17:01:39.431+03:00 level=INFO source=types.go:130 msg="inference compute" id=0 library=cpu variant="" compute="" driver=0.0 name="" total="62.3 GiB" available="55.2 GiB"
[GIN] 2025/07/02 - 17:02:06 | 200 |      59.964µs |       127.0.0.1 | HEAD     "/"
[GIN] 2025/07/02 - 17:02:06 | 404 |     475.631µs |       127.0.0.1 | POST     "/api/show"
[GIN] 2025/07/02 - 17:02:06 | 200 |  671.350852ms |       127.0.0.1 | POST     "/api/pull"
[GIN] 2025/07/02 - 17:02:11 | 200 |      45.818µs |       127.0.0.1 | HEAD     "/"
[GIN] 2025/07/02 - 17:02:11 | 200 |     928.085µs |       127.0.0.1 | GET      "/api/tags"
[GIN] 2025/07/02 - 17:02:24 | 200 |      31.246µs |       127.0.0.1 | HEAD     "/"
[GIN] 2025/07/02 - 17:02:25 | 200 |  112.861202ms |       127.0.0.1 | POST     "/api/show"
time=2025-07-02T17:02:25.237+03:00 level=INFO source=server.go:135 msg="system memory" total="62.3 GiB" free="55.6 GiB" free_swap="4.0 GiB"
time=2025-07-02T17:02:25.239+03:00 level=INFO source=server.go:187 msg=offload library=cpu layers.requested=-1 layers.model=36 layers.offload=0 layers.split="" memory.available="[55.6 GiB]" memory.gpu_overhead="0 B" memory.required.full="10.8 GiB" memory.required.partial="0 B" memory.required.kv="280.0 MiB" memory.required.allocations="[10.8 GiB]" memory.weights.total="8.3 GiB" memory.weights.repeating="7.3 GiB" memory.weights.nonrepeating="1.0 GiB" memory.graph.full="2.0 GiB" memory.graph.partial="3.7 GiB"
time=2025-07-02T17:02:25.309+03:00 level=INFO source=server.go:458 msg="starting llama server" cmd="/home/filip/Downloads/ollama-ipex-llm-2.3.0b20250630-ubuntu/ollama-bin runner --ollama-engine --model /home/filip/.ollama/models/blobs/sha256-e4e9439b8ee5aa6213d487a6780c0618fe971e0582e11b7cc3741a1230205644 --ctx-size 4096 --batch-size 512 --n-gpu-layers 999 --threads 8 --no-mmap --parallel 2 --port 40237"
time=2025-07-02T17:02:25.310+03:00 level=INFO source=sched.go:483 msg="loaded runners" count=1
time=2025-07-02T17:02:25.310+03:00 level=INFO source=server.go:618 msg="waiting for llama runner to start responding"
time=2025-07-02T17:02:25.311+03:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server not responding"
time=2025-07-02T17:02:25.365+03:00 level=INFO source=runner.go:925 msg="starting ollama engine"
time=2025-07-02T17:02:25.365+03:00 level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:40237"
time=2025-07-02T17:02:25.427+03:00 level=INFO source=ggml.go:96 msg="" architecture=gemma3n file_type=F16 name="" description="" num_tensors=847 num_key_values=40
SIGSEGV: segmentation violation
PC=0x7f651452276f m=7 sigcode=1 addr=0x8
signal arrived during cgo execution

goroutine 13 gp=0xc000103dc0 m=7 mp=0xc000580008 [syscall]:
runtime.cgocall(0x1168450, 0xc000050d58)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/cgocall.go:167 +0x4b fp=0xc000050d30 sp=0xc000050cf8 pc=0x4977ab
github.com/ollama/ollama/ml/backend/ggml/ggml/src._Cfunc_ggml_backend_load_all_from_path(0x7f64b0000d30)
	_cgo_gotypes.go:195 +0x3a fp=0xc000050d58 sp=0xc000050d30 pc=0x84301a
github.com/ollama/ollama/ml/backend/ggml/ggml/src.init.func1.1({0xc0000400b4, 0x3b})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend/ggml/ggml/src/ggml.go:97 +0xf5 fp=0xc000050df0 sp=0xc000050d58 pc=0x842ab5
github.com/ollama/ollama/ml/backend/ggml/ggml/src.init.func1()
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend/ggml/ggml/src/ggml.go:98 +0x526 fp=0xc000051080 sp=0xc000050df0 pc=0x842906
github.com/ollama/ollama/ml/backend/ggml/ggml/src.init.OnceFunc.func2()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/sync/oncefunc.go:27 +0x62 fp=0xc0000510c8 sp=0xc000051080 pc=0x842302
sync.(*Once).doSlow(0xc000051150?, 0x498739?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/sync/once.go:78 +0xab fp=0xc000051120 sp=0xc0000510c8 pc=0x4ac78b
sync.(*Once).Do(0xc0004c21b0?, 0xc000051178?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/sync/once.go:69 +0x19 fp=0xc000051140 sp=0xc000051120 pc=0x4ac6b9
github.com/ollama/ollama/ml/backend/ggml/ggml/src.init.OnceFunc.func3()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/sync/oncefunc.go:32 +0x2d fp=0xc000051170 sp=0xc000051140 pc=0x84226d
github.com/ollama/ollama/ml/backend/ggml.devices()
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend/ggml/ggml.go:41 +0x1e fp=0xc0000511b0 sp=0xc000051170 pc=0x8d63de
github.com/ollama/ollama/ml/backend/ggml.New({0x7ffebeb84e11, 0x68}, {0x8, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend/ggml/ggml.go:115 +0x537 fp=0xc000051c18 sp=0xc0000511b0 pc=0x8d69b7
github.com/ollama/ollama/ml.NewBackend({0x7ffebeb84e11, 0x68}, {0x8, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend.go:209 +0xb1 fp=0xc000051c70 sp=0xc000051c18 pc=0x8c9311
github.com/ollama/ollama/model.New({0x7ffebeb84e11?, 0x0?}, {0x8, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/model/model.go:102 +0x8f fp=0xc000051d68 sp=0xc000051c70 pc=0x8e706f
github.com/ollama/ollama/runner/ollamarunner.(*Server).initModel(0xc0001339e0, {0x7ffebeb84e11?, 0x0?}, {0x8, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0}, ...)
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:841 +0x8d fp=0xc000051dc8 sp=0xc000051d68 pc=0x9895ad
github.com/ollama/ollama/runner/ollamarunner.(*Server).load(0xc0001339e0, {0x15f3a90, 0xc000530a50}, {0x7ffebeb84e11?, 0x0?}, {0x8, 0x0, 0x3e7, {0x0, 0x0, ...}, ...}, ...)
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:878 +0xb8 fp=0xc000051f20 sp=0xc000051dc8 pc=0x989918
github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap1()
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:959 +0xc7 fp=0xc000051fe0 sp=0xc000051f20 pc=0x98ad47
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000051fe8 sp=0xc000051fe0 pc=0x4a2281
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:959 +0xa11

goroutine 1 gp=0xc000002380 m=nil [IO wait]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000687650 sp=0xc000687630 pc=0x49ac2e
runtime.netpollblock(0x4989b3?, 0x433d46?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/netpoll.go:575 +0xf7 fp=0xc000687688 sp=0xc000687650 pc=0x45f8f7
internal/poll.runtime_pollWait(0x7f652a8c7eb0, 0x72)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/netpoll.go:351 +0x85 fp=0xc0006876a8 sp=0xc000687688 pc=0x499e45
internal/poll.(*pollDesc).wait(0xc000496d00?, 0x380016?, 0x0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:84 +0x27 fp=0xc0006876d0 sp=0xc0006876a8 pc=0x521167
internal/poll.(*pollDesc).waitRead(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_poll_runtime.go:89
internal/poll.(*FD).Accept(0xc000496d00)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/internal/poll/fd_unix.go:620 +0x295 fp=0xc000687778 sp=0xc0006876d0 pc=0x526535
net.(*netFD).accept(0xc000496d00)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/fd_unix.go:172 +0x29 fp=0xc000687830 sp=0xc000687778 pc=0x598a49
net.(*TCPListener).accept(0xc00053f000)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/tcpsock_posix.go:159 +0x1b fp=0xc000687880 sp=0xc000687830 pc=0x5ae3bb
net.(*TCPListener).Accept(0xc00053f000)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/tcpsock.go:380 +0x30 fp=0xc0006878b0 sp=0xc000687880 pc=0x5ad270
net/http.(*onceCloseListener).Accept(0x15f3a20?)
	<autogenerated>:1 +0x24 fp=0xc0006878c8 sp=0xc0006878b0 pc=0x7c4904
net/http.(*Server).Serve(0xc0001fe600, {0x15f1468, 0xc00053f000})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/net/http/server.go:3424 +0x30c fp=0xc0006879f8 sp=0xc0006878c8 pc=0x79c1cc
github.com/ollama/ollama/runner/ollamarunner.Execute({0xc000034150, 0xf, 0xf})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:984 +0xe09 fp=0xc000687d08 sp=0xc0006879f8 pc=0x98a9a9
github.com/ollama/ollama/runner.Execute({0xc000034130?, 0x0?, 0x0?})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/runner.go:20 +0xc9 fp=0xc000687d30 sp=0xc000687d08 pc=0x98b2a9
github.com/ollama/ollama/cmd.NewCLI.func2(0xc000119000?, {0x1419fa2?, 0x4?, 0x1419fa6?})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/cmd/cmd.go:1529 +0x45 fp=0xc000687d58 sp=0xc000687d30 pc=0x10e7a45
github.com/spf13/cobra.(*Command).execute(0xc0004c4f08, {0xc000119200, 0x10, 0x10})
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:940 +0x85c fp=0xc000687e78 sp=0xc000687d58 pc=0x61205c
github.com/spf13/cobra.(*Command).ExecuteC(0xc00017b208)
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:1068 +0x3a5 fp=0xc000687f30 sp=0xc000687e78 pc=0x6128a5
github.com/spf13/cobra.(*Command).Execute(...)
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:992
github.com/spf13/cobra.(*Command).ExecuteContext(...)
	/root/go/pkg/mod/github.com/spf13/cobra@v1.7.0/command.go:985
main.main()
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/main.go:12 +0x4d fp=0xc000687f50 sp=0xc000687f30 pc=0x10e84cd
runtime.main()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:283 +0x28b fp=0xc000687fe0 sp=0xc000687f50 pc=0x466f0b
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000687fe8 sp=0xc000687fe0 pc=0x4a2281

goroutine 2 gp=0xc000002e00 m=nil [force gc (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000088fa8 sp=0xc000088f88 pc=0x49ac2e
runtime.goparkunlock(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441
runtime.forcegchelper()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:348 +0xb3 fp=0xc000088fe0 sp=0xc000088fa8 pc=0x467253
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000088fe8 sp=0xc000088fe0 pc=0x4a2281
created by runtime.init.7 in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:336 +0x1a

goroutine 3 gp=0xc000003340 m=nil [GC sweep wait]:
runtime.gopark(0x1?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000089780 sp=0xc000089760 pc=0x49ac2e
runtime.goparkunlock(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441
runtime.bgsweep(0xc000048080)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgcsweep.go:316 +0xdf fp=0xc0000897c8 sp=0xc000089780 pc=0x451a7f
runtime.gcenable.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:204 +0x25 fp=0xc0000897e0 sp=0xc0000897c8 pc=0x445ee5
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000897e8 sp=0xc0000897e0 pc=0x4a2281
created by runtime.gcenable in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:204 +0x66

goroutine 4 gp=0xc000003500 m=nil [GC scavenge wait]:
runtime.gopark(0x10000?, 0x15dea98?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000089f78 sp=0xc000089f58 pc=0x49ac2e
runtime.goparkunlock(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441
runtime.(*scavengerState).park(0x20e1940)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgcscavenge.go:425 +0x49 fp=0xc000089fa8 sp=0xc000089f78 pc=0x44f4c9
runtime.bgscavenge(0xc000048080)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgcscavenge.go:658 +0x59 fp=0xc000089fc8 sp=0xc000089fa8 pc=0x44fa59
runtime.gcenable.gowrap2()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:205 +0x25 fp=0xc000089fe0 sp=0xc000089fc8 pc=0x445e85
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000089fe8 sp=0xc000089fe0 pc=0x4a2281
created by runtime.gcenable in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:205 +0xa5

goroutine 5 gp=0xc000003dc0 m=nil [finalizer wait]:
runtime.gopark(0x1b8?, 0xc000002380?, 0x1?, 0x23?, 0xc000088688?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000088630 sp=0xc000088610 pc=0x49ac2e
runtime.runfinq()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mfinal.go:196 +0x107 fp=0xc0000887e0 sp=0xc000088630 pc=0x444ea7
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000887e8 sp=0xc0000887e0 pc=0x4a2281
created by runtime.createfing in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mfinal.go:166 +0x3d

goroutine 6 gp=0xc0001e68c0 m=nil [chan receive]:
runtime.gopark(0xc00018f9a0?, 0xc00011a048?, 0x60?, 0xa7?, 0x57f788?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00008a718 sp=0xc00008a6f8 pc=0x49ac2e
runtime.chanrecv(0xc00003c380, 0x0, 0x1)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/chan.go:664 +0x445 fp=0xc00008a790 sp=0xc00008a718 pc=0x4368c5
runtime.chanrecv1(0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/chan.go:506 +0x12 fp=0xc00008a7b8 sp=0xc00008a790 pc=0x436452
runtime.unique_runtime_registerUniqueMapCleanup.func2(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1796
runtime.unique_runtime_registerUniqueMapCleanup.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1799 +0x2f fp=0xc00008a7e0 sp=0xc00008a7b8 pc=0x44902f
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00008a7e8 sp=0xc00008a7e0 pc=0x4a2281
created by unique.runtime_registerUniqueMapCleanup in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1794 +0x79

goroutine 7 gp=0xc0001e6c40 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00008af38 sp=0xc00008af18 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00008afc8 sp=0xc00008af38 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00008afe0 sp=0xc00008afc8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00008afe8 sp=0xc00008afe0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 18 gp=0xc000102380 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000084738 sp=0xc000084718 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000847c8 sp=0xc000084738 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000847e0 sp=0xc0000847c8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000847e8 sp=0xc0000847e0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 19 gp=0xc000102540 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000084f38 sp=0xc000084f18 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000084fc8 sp=0xc000084f38 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000084fe0 sp=0xc000084fc8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000084fe8 sp=0xc000084fe0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 34 gp=0xc000504000 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00050a738 sp=0xc00050a718 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00050a7c8 sp=0xc00050a738 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00050a7e0 sp=0xc00050a7c8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00050a7e8 sp=0xc00050a7e0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 20 gp=0xc000102700 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000085738 sp=0xc000085718 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000857c8 sp=0xc000085738 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000857e0 sp=0xc0000857c8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000857e8 sp=0xc0000857e0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 21 gp=0xc0001028c0 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000085f38 sp=0xc000085f18 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000085fc8 sp=0xc000085f38 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000085fe0 sp=0xc000085fc8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000085fe8 sp=0xc000085fe0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 22 gp=0xc000102a80 m=nil [GC worker (idle)]:
runtime.gopark(0x0?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000086738 sp=0xc000086718 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000867c8 sp=0xc000086738 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000867e0 sp=0xc0000867c8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000867e8 sp=0xc0000867e0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 23 gp=0xc000102c40 m=nil [GC worker (idle)]:
runtime.gopark(0xc35bebde049?, 0x3?, 0xde?, 0x91?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000086f38 sp=0xc000086f18 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000086fc8 sp=0xc000086f38 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000086fe0 sp=0xc000086fc8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000086fe8 sp=0xc000086fe0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 24 gp=0xc000102e00 m=nil [GC worker (idle)]:
runtime.gopark(0xc35beaf5fd8?, 0x1?, 0x68?, 0xd?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000087738 sp=0xc000087718 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0000877c8 sp=0xc000087738 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0000877e0 sp=0xc0000877c8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0000877e8 sp=0xc0000877e0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 25 gp=0xc000102fc0 m=nil [GC worker (idle)]:
runtime.gopark(0xc35bec321c8?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000087f38 sp=0xc000087f18 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000087fc8 sp=0xc000087f38 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000087fe0 sp=0xc000087fc8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000087fe8 sp=0xc000087fe0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 8 gp=0xc0001e6e00 m=nil [GC worker (idle)]:
runtime.gopark(0xc35bec88804?, 0x1?, 0xf?, 0x64?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00008b738 sp=0xc00008b718 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00008b7c8 sp=0xc00008b738 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00008b7e0 sp=0xc00008b7c8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00008b7e8 sp=0xc00008b7e0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 9 gp=0xc0001e6fc0 m=nil [GC worker (idle)]:
runtime.gopark(0xc35beb799a4?, 0x1?, 0x43?, 0xc8?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00008bf38 sp=0xc00008bf18 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00008bfc8 sp=0xc00008bf38 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00008bfe0 sp=0xc00008bfc8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00008bfe8 sp=0xc00008bfe0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 35 gp=0xc0005041c0 m=nil [GC worker (idle)]:
runtime.gopark(0xc35beabb2b1?, 0x3?, 0x8d?, 0x61?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00050af38 sp=0xc00050af18 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc00050afc8 sp=0xc00050af38 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc00050afe0 sp=0xc00050afc8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00050afe8 sp=0xc00050afe0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 10 gp=0xc0001e7180 m=nil [GC worker (idle)]:
runtime.gopark(0xc35beae64fd?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000506738 sp=0xc000506718 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0005067c8 sp=0xc000506738 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0005067e0 sp=0xc0005067c8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0005067e8 sp=0xc0005067e0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 11 gp=0xc0001e7340 m=nil [GC worker (idle)]:
runtime.gopark(0xc35bebb2ca8?, 0x1?, 0xbb?, 0x85?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000506f38 sp=0xc000506f18 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc000506fc8 sp=0xc000506f38 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc000506fe0 sp=0xc000506fc8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc000506fe8 sp=0xc000506fe0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 12 gp=0xc0001e7500 m=nil [GC worker (idle)]:
runtime.gopark(0xc35be85e253?, 0x0?, 0x0?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc000507738 sp=0xc000507718 pc=0x49ac2e
runtime.gcBgMarkWorker(0xc00003d7a0)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1423 +0xe9 fp=0xc0005077c8 sp=0xc000507738 pc=0x448349
runtime.gcBgMarkStartWorkers.gowrap1()
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x25 fp=0xc0005077e0 sp=0xc0005077c8 pc=0x448225
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc0005077e8 sp=0xc0005077e0 pc=0x4a2281
created by runtime.gcBgMarkStartWorkers in goroutine 1
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/mgc.go:1339 +0x105

goroutine 14 gp=0xc000504700 m=nil [sync.WaitGroup.Wait]:
runtime.gopark(0x0?, 0x0?, 0x60?, 0x0?, 0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:435 +0xce fp=0xc00050d6d0 sp=0xc00050d6b0 pc=0x49ac2e
runtime.goparkunlock(...)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/proc.go:441
runtime.semacquire1(0xc0001339e8, 0x0, 0x1, 0x0, 0x18)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/sema.go:188 +0x21d fp=0xc00050d738 sp=0xc00050d6d0 pc=0x47a41d
sync.runtime_SemacquireWaitGroup(0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/sema.go:110 +0x25 fp=0xc00050d770 sp=0xc00050d738 pc=0x49c625
sync.(*WaitGroup).Wait(0x0?)
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/sync/waitgroup.go:118 +0x48 fp=0xc00050d798 sp=0xc00050d770 pc=0x4adbc8
github.com/ollama/ollama/runner/ollamarunner.(*Server).run(0xc0001339e0, {0x15f3a90, 0xc000530a50})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:355 +0x25 fp=0xc00050d7b8 sp=0xc00050d798 pc=0x9854c5
github.com/ollama/ollama/runner/ollamarunner.Execute.gowrap2()
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:960 +0x28 fp=0xc00050d7e0 sp=0xc00050d7b8 pc=0x98ac48
runtime.goexit({})
	/root/go/pkg/mod/golang.org/toolchain@v0.0.1-go1.24.0.linux-amd64/src/runtime/asm_amd64.s:1700 +0x1 fp=0xc00050d7e8 sp=0xc00050d7e0 pc=0x4a2281
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:960 +0xa74

rax    0x7f64b0004340
rbx    0x0
rcx    0x7f64caff8570
rdx    0x4
rdi    0x0
rsi    0x0
rbp    0x0
rsp    0x7f64caff8450
r8     0x0
r9     0x7f64b0000030
r10    0x0
r11    0xf0ca7badcf26f777
r12    0x0
r13    0x7f64b000f1c0
r14    0x7f64caff8570
r15    0x4
rip    0x7f651452276f
rflags 0x10202
cs     0x33
fs     0x0
gs     0x0
time=2025-07-02T17:02:25.561+03:00 level=ERROR source=sched.go:489 msg="error loading llama server" error="llama runner process has terminated: exit status 2"
[GIN] 2025/07/02 - 17:02:25 | 500 |  511.694099ms |       127.0.0.1 | POST     "/api/generate"

and I have the same error for the gemma3:4b-it-fp16

Intel B580

[savvadesogle]

Same on Ubuntu 22.04.05 (A770) 6.5.0-35 kernel

arc@xpu:~/Downloads/ollama-ipex-llm-2.3.0b20250630-ubuntu$ ./start-ollama.sh
time=2025-07-02T17:24:44.742+03:00 level=INFO source=routes.go:1235 msg="server config" env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_CONTEXT_LENGTH:4096 OLLAMA_DEBUG:INFO OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:10m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/home/arc/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NEW_ENGINE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://* vscode-file://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:localhost,127.0.0.1]"
time=2025-07-02T17:24:44.742+03:00 level=INFO source=images.go:476 msg="total blobs: 10"
time=2025-07-02T17:24:44.743+03:00 level=INFO source=images.go:483 msg="total unused blobs removed: 0"
[GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.

[GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
 - using env:	export GIN_MODE=release
 - using code:	gin.SetMode(gin.ReleaseMode)

[GIN-debug] HEAD   /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
[GIN-debug] GET    /                         --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
[GIN-debug] HEAD   /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func3 (5 handlers)
[GIN-debug] GET    /api/version              --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func4 (5 handlers)
[GIN-debug] POST   /api/pull                 --> github.com/ollama/ollama/server.(*Server).PullHandler-fm (5 handlers)
[GIN-debug] POST   /api/push                 --> github.com/ollama/ollama/server.(*Server).PushHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] GET    /api/tags                 --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
[GIN-debug] POST   /api/show                 --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (5 handlers)
[GIN-debug] DELETE /api/delete               --> github.com/ollama/ollama/server.(*Server).DeleteHandler-fm (5 handlers)
[GIN-debug] POST   /api/create               --> github.com/ollama/ollama/server.(*Server).CreateHandler-fm (5 handlers)
[GIN-debug] POST   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).CreateBlobHandler-fm (5 handlers)
[GIN-debug] HEAD   /api/blobs/:digest        --> github.com/ollama/ollama/server.(*Server).HeadBlobHandler-fm (5 handlers)
[GIN-debug] POST   /api/copy                 --> github.com/ollama/ollama/server.(*Server).CopyHandler-fm (5 handlers)
[GIN-debug] GET    /api/ps                   --> github.com/ollama/ollama/server.(*Server).PsHandler-fm (5 handlers)
[GIN-debug] POST   /api/generate             --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (5 handlers)
[GIN-debug] POST   /api/chat                 --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (5 handlers)
[GIN-debug] POST   /api/embed                --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (5 handlers)
[GIN-debug] POST   /api/embeddings           --> github.com/ollama/ollama/server.(*Server).EmbeddingsHandler-fm (5 handlers)
[GIN-debug] POST   /v1/chat/completions      --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (6 handlers)
[GIN-debug] POST   /v1/completions           --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (6 handlers)
[GIN-debug] POST   /v1/embeddings            --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models                --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (6 handlers)
[GIN-debug] GET    /v1/models/:model         --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (6 handlers)
time=2025-07-02T17:24:44.743+03:00 level=INFO source=routes.go:1288 msg="Listening on 127.0.0.1:11434 (version 0.9.3)"
time=2025-07-02T17:24:44.743+03:00 level=INFO source=gpu.go:217 msg="looking for compatible GPUs"
time=2025-07-02T17:24:44.743+03:00 level=INFO source=gpu.go:218 msg="using Intel GPU"
time=2025-07-02T17:24:44.756+03:00 level=INFO source=types.go:130 msg="inference compute" id=0 library=cpu variant="" compute="" driver=0.0 name="" total="125.8 GiB" available="120.9 GiB"
[GIN] 2025/07/02 - 17:24:59 | 200 |     102.481µs |       127.0.0.1 | HEAD     "/"
[GIN] 2025/07/02 - 17:24:59 | 200 |  208.347134ms |       127.0.0.1 | POST     "/api/show"
time=2025-07-02T17:24:59.881+03:00 level=INFO source=server.go:135 msg="system memory" total="125.8 GiB" free="120.8 GiB" free_swap="0 B"
time=2025-07-02T17:24:59.882+03:00 level=INFO source=server.go:187 msg=offload library=cpu layers.requested=-1 layers.model=36 layers.offload=0 layers.split="" memory.available="[120.8 GiB]" memory.gpu_overhead="0 B" memory.required.full="5.0 GiB" memory.required.partial="0 B" memory.required.kv="280.0 MiB" memory.required.allocations="[5.0 GiB]" memory.weights.total="2.6 GiB" memory.weights.repeating="2.2 GiB" memory.weights.nonrepeating="420.4 MiB" memory.graph.full="2.0 GiB" memory.graph.partial="3.7 GiB"
time=2025-07-02T17:25:00.065+03:00 level=INFO source=server.go:458 msg="starting llama server" cmd="/home/arc/Downloads/ollama-ipex-llm-2.3.0b20250630-ubuntu/ollama-bin runner --ollama-engine --model /home/arc/.ollama/models/blobs/sha256-38e8dcc30df4eb0e29eaf5c74ba6ce3f2cd66badad50768fc14362acfb8b8cb6 --ctx-size 4096 --batch-size 512 --n-gpu-layers 999 --threads 36 --no-mmap --parallel 2 --port 33041"
time=2025-07-02T17:25:00.066+03:00 level=INFO source=sched.go:483 msg="loaded runners" count=1
time=2025-07-02T17:25:00.066+03:00 level=INFO source=server.go:618 msg="waiting for llama runner to start responding"
time=2025-07-02T17:25:00.066+03:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server not responding"
time=2025-07-02T17:25:00.135+03:00 level=INFO source=runner.go:925 msg="starting ollama engine"
time=2025-07-02T17:25:00.136+03:00 level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:33041"
time=2025-07-02T17:25:00.235+03:00 level=INFO source=ggml.go:96 msg="" architecture=gemma3n file_type=Q4_K_M name="" description="" num_tensors=847 num_key_values=40
load_backend: loaded SYCL backend from /home/arc/Downloads/ollama-ipex-llm-2.3.0b20250630-ubuntu/libggml-sycl.so
load_backend: loaded CPU backend from /home/arc/Downloads/ollama-ipex-llm-2.3.0b20250630-ubuntu/libggml-cpu-haswell.so
time=2025-07-02T17:25:00.291+03:00 level=INFO source=ggml.go:104 msg=system CPU.0.LLAMAFILE=1 CPU.0.OPENMP=1 CPU.0.AARCH64_REPACK=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc)
Running with Environment Variables:
  GGML_SYCL_DEBUG: 0
  GGML_SYCL_DISABLE_OPT: 1
  GGML_SYCL_DISABLE_GRAPH: 1
  GGML_SYCL_PRIORITIZE_DMMV: 0
Build with Macros:
  GGML_SYCL_FORCE_MMQ: no
  GGML_SYCL_F16: no
Found 4 SYCL devices:
|  |                   |                                       |       |Max    |        |Max  |Global |                     |
|  |                   |                                       |       |compute|Max work|sub  |mem    |                     |
|ID|        Device Type|                                   Name|Version|units  |group   |group|size   |       Driver version|
|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
| 0| [level_zero:gpu:0]|                Intel Arc A770 Graphics|  12.55|    512|    1024|   32| 16225M|            1.3.27642|
| 1| [level_zero:gpu:1]|                Intel Arc A770 Graphics|  12.55|    512|    1024|   32| 16225M|            1.3.27642|
| 2| [level_zero:gpu:2]|                Intel Arc A770 Graphics|  12.55|    512|    1024|   32| 16225M|            1.3.27642|
| 3| [level_zero:gpu:3]|                Intel Arc A770 Graphics|  12.55|    512|    1024|   32| 16225M|            1.3.27642|
SYCL Optimization Feature:
|ID|        Device Type|Reorder|
|--|-------------------|-------|
| 0| [level_zero:gpu:0]|      Y|
| 1| [level_zero:gpu:1]|      Y|
| 2| [level_zero:gpu:2]|      Y|
| 3| [level_zero:gpu:3]|      Y|
time=2025-07-02T17:25:00.318+03:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server loading model"
ggml_backend_sycl_buffer_type_alloc_buffer: can't allocate 4697620480 Bytes of memory on device
alloc_tensor_range: failed to allocate SYCL0 buffer of size 4697620480
panic: insufficient memory - required allocations: {InputWeights:440832000A CPU:{Name:CPU UUID: Weights:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Cache:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Graph:0U} GPUs:[{Name:SYCL0 UUID: Weights:[72269184F 72269184F 72269184F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 63348096F 63348096F 72269184F 72269184F 72269184F 72269184F 72269184F 5162939392F] Cache:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Graph:0U}]}

goroutine 87 [running]:
github.com/ollama/ollama/ml/backend/ggml.New({0x7ffd807600ce, 0x66}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend/ggml/ggml.go:380 +0x30b6
github.com/ollama/ollama/ml.NewBackend({0x7ffd807600ce, 0x66}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend.go:209 +0xb1
github.com/ollama/ollama/model.New({0x7ffd807600ce?, 0x0?}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/model/model.go:102 +0x8f
github.com/ollama/ollama/runner/ollamarunner.(*Server).initModel(0xc000034360, {0x7ffd807600ce?, 0x0?}, {0x24, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0}, ...)
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:841 +0x8d
github.com/ollama/ollama/runner/ollamarunner.(*Server).load(0xc000034360, {0x15f3a90, 0xc00040d950}, {0x7ffd807600ce?, 0x0?}, {0x24, 0x0, 0x3e7, {0x0, 0x0, ...}, ...}, ...)
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:878 +0xb8
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
	/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:959 +0xa11
time=2025-07-02T17:25:01.070+03:00 level=ERROR source=sched.go:489 msg="error loading llama server" error="llama runner process has terminated: exit status 2"
[GIN] 2025/07/02 - 17:25:01 | 500 |   1.61100836s |       127.0.0.1 | POST     "/api/generate"

[yizhangliu]

@rnwang04

[GIN] 2025/07/02 - 22:18:00 | 500 | 1.254786566s | 127.0.0.1 | POST "/api/generate"
[GIN] 2025/07/02 - 22:18:38 | 200 | 21.324µs | 127.0.0.1 | HEAD "/"
[GIN] 2025/07/02 - 22:18:39 | 200 | 655.776804ms | 127.0.0.1 | POST "/api/show"
time=2025-07-02T22:18:39.599+08:00 level=INFO source=server.go:135 msg="system memory" total="15.6 GiB" free="13.1 GiB" free_swap="16.0 GiB"
time=2025-07-02T22:18:39.599+08:00 level=INFO source=server.go:187 msg=offload library=cpu layers.requested=-1 layers.model=31 layers.offload=0 layers.split="" memory.available="[13.1 GiB]" memory.gpu_overhead="0 B" memory.required.full="3.7 GiB" memory.required.partial="0 B" memory.required.kv="240.0 MiB" memory.required.allocations="[3.7 GiB]" memory.weights.total="1.4 GiB" memory.weights.repeating="1.0 GiB" memory.weights.nonrepeating="420.4 MiB" memory.graph.full="2.0 GiB" memory.graph.partial="3.7 GiB"
time=2025-07-02T22:18:39.712+08:00 level=INFO source=server.go:458 msg="starting llama server" cmd="/home/liuyz/packages/ollama-ipex-llm-2.3.0b20250630-ubuntu/ollama-bin runner --ollama-engine --model /mnt/d/Ollama_models/blobs/sha256-3839a254cf2d00b208c6e2524c129e4438f9d106bba4c3fbc12b631f519d1de1 --ctx-size 4096 --batch-size 512 --n-gpu-layers 999 --threads 10 --no-mmap --parallel 2 --port 42955"
time=2025-07-02T22:18:39.712+08:00 level=INFO source=sched.go:483 msg="loaded runners" count=1
time=2025-07-02T22:18:39.712+08:00 level=INFO source=server.go:618 msg="waiting for llama runner to start responding"
time=2025-07-02T22:18:39.713+08:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server not responding"
time=2025-07-02T22:18:39.742+08:00 level=INFO source=runner.go:925 msg="starting ollama engine"
time=2025-07-02T22:18:39.744+08:00 level=INFO source=runner.go:983 msg="Server listening on 127.0.0.1:42955"
time=2025-07-02T22:18:39.965+08:00 level=INFO source=server.go:652 msg="waiting for server to become available" status="llm server loading model"
time=2025-07-02T22:18:40.060+08:00 level=INFO source=ggml.go:96 msg="" architecture=gemma3n file_type=Q4_K_M name="" description="" num_tensors=727 num_key_values=40
load_backend: loaded SYCL backend from /home/liuyz/packages/ollama-ipex-llm-2.3.0b20250630-ubuntu/libggml-sycl.so
load_backend: loaded CPU backend from /home/liuyz/packages/ollama-ipex-llm-2.3.0b20250630-ubuntu/libggml-cpu-alderlake.so
time=2025-07-02T22:18:40.108+08:00 level=INFO source=ggml.go:104 msg=system CPU.0.LLAMAFILE=1 CPU.0.OPENMP=1 CPU.0.AARCH64_REPACK=1 CPU.1.LLAMAFILE=1 compiler=cgo(gcc)
Running with Environment Variables:
GGML_SYCL_DEBUG: 0
GGML_SYCL_DISABLE_OPT: 1
GGML_SYCL_DISABLE_GRAPH: 1
GGML_SYCL_PRIORITIZE_DMMV: 0
Build with Macros:
GGML_SYCL_FORCE_MMQ: no
GGML_SYCL_F16: no
Found 1 SYCL devices:
| | | | |Max | |Max |Global | |
| | | | |compute|Max work|sub |mem | |

ID	Device Type	Name	Version	units	group	group	size	Driver version
0	[level_zero:gpu:0]	Intel Graphics [0xa7a0]	12.3	96	512	32	15508M	1.6.32224+14
SYCL Optimization Feature:
ID	Device Type	Reorder
--	-------------------	-------
0	[level_zero:gpu:0]	N
get_memory_info: [warning] ext_intel_free_memory is not supported (export/set ZES_ENABLE_SYSMAN=1 to support), use total memory as free memory
ggml_backend_sycl_buffer_type_alloc_buffer: can't allocate 4026531840 Bytes of memory on device
alloc_tensor_range: failed to allocate SYCL0 buffer of size 4026531840
panic: insufficient memory - required allocations: {InputWeights:440832000A CPU:{Name:CPU UUID: Weights:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Cache:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Graph:0U} GPUs:[{Name:SYCL0 UUID: Weights:[39632256F 39632256F 39632256F 35036544F 35036544F 39632256F 35036544F 35036544F 39632256F 35036544F 35036544F 39632256F 35036544F 35036544F 39632256F 35036544F 35036544F 39632256F 35036544F 35036544F 39632256F 35036544F 35036544F 39632256F 35036544F 35036544F 39632256F 39632256F 39632256F 39632256F 4490376192F] Cache:[0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U 0U] Graph:0U}]}

goroutine 11 [running]:
github.com/ollama/ollama/ml/backend/ggml.New({0x7fff98af3f86, 0x62}, {0xa, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend/ggml/ggml.go:380 +0x30b6
github.com/ollama/ollama/ml.NewBackend({0x7fff98af3f86, 0x62}, {0xa, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/ml/backend.go:209 +0xb1
github.com/ollama/ollama/model.New({0x7fff98af3f86?, 0x0?}, {0xa, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0})
/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/model/model.go:102 +0x8f
github.com/ollama/ollama/runner/ollamarunner.(*Server).initModel(0xc000160120, {0x7fff98af3f86?, 0x0?}, {0xa, 0x0, 0x3e7, {0x0, 0x0, 0x0}, 0x0}, ...)
/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:841 +0x8d
github.com/ollama/ollama/runner/ollamarunner.(*Server).load(0xc000160120, {0x15f3a90, 0xc000174550}, {0x7fff98af3f86?, 0x0?}, {0xa, 0x0, 0x3e7, {0x0, 0x0, ...}, ...}, ...)
/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:878 +0xb8
created by github.com/ollama/ollama/runner/ollamarunner.Execute in goroutine 1
/home/runner/_work/llm.cpp/llm.cpp/ollama-internal/runner/ollamarunner/runner.go:959 +0xa11
time=2025-07-02T22:18:40.466+08:00 level=ERROR source=sched.go:489 msg="error loading llama server" error="llama runner process has terminated: exit status 2"

[rnwang04]

@savvadesogle @yizhangliu It seems you are facing the same error.
Have you ever run other ollama models successfully or run other version ollama portable zip successfully on your machine ?
At the same time, have you ever enabled the Resizable BAR in your system's BIOS ? For detailed steps, please refer to the official guidance here.
@savvadesogle Besides, currently for ollama runner, multi-card is not supported as there remain some bugs, we are trying to fix this. So you want to run gemma3n, please limit to one card first:

# linux
export ONEAPI_DEVICE_SELECTOR=level_zero:0
./ollama serve

# windows
set ONEAPI_DEVICE_SELECTOR=level_zero:0
ollama serve

[rnwang04]

Hi @FilipLaurentiu , we never meet such error before. What is your CPU & GPU ? And have you ever run other ollama models successfully or run other version ollama portable zip successfully on your machine ?