You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
- The GGUF endian conversion script may not support all data types at the moment and may fail for some models/quantizations. When that happens, please try manually converting the safetensors model to GGUF Big-Endian via Step 2.
111
125
112
126
## IBM Accelerators
113
127
114
128
### 1. SIMD Acceleration
115
129
116
-
Only available in IBM z15 or later system with the `-DGGML_VXE=ON` (turned on by default) compile flag. No hardware acceleration is possible with llama.cpp with older systems, such as IBM z14 or EC13. In such systems, the APIs can still run but will use a scalar implementation.
130
+
Only available in IBM z15 or later system with the `-DGGML_VXE=ON` (turned on by default) compile flag. No hardware acceleration is possible with llama.cpp with older systems, such as IBM z14/arch12. In such systems, the APIs can still run but will use a scalar implementation.
131
+
132
+
### 2. NNPA Vector Intrinsics Acceleration
117
133
118
-
### 2. zDNN Accelerator
134
+
Only available in IBM z16 or later system with the `-DGGML_NNPA=ON` (turned on when available) compile flag. No hardware acceleration is possible with llama.cpp with older systems, such as IBM z15/arch13. In such systems, the APIs can still run but will use a scalar implementation.
119
135
120
-
*Only available in IBM z16 or later system. No direction at the moment.*
136
+
### 3. zDNN Accelerator
121
137
122
-
### 3. Spyre Accelerator
138
+
_Only available in IBM z16 or later system. No direction at the moment._
123
139
124
-
*No direction at the moment.*
140
+
### 4. Spyre Accelerator
141
+
142
+
_No direction at the moment._
125
143
126
144
## Performance Tuning
127
145
@@ -154,4 +172,3 @@ IBM VXE/VXE2 SIMD acceleration depends on the BLAS implementation. It is strongl
Copy file name to clipboardExpand all lines: docs/build.md
+4Lines changed: 4 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -557,6 +557,10 @@ ninja
557
557
558
558
To read documentation for how to build on Android, [click here](./android.md)
559
559
560
+
## IBM Z & LinuxONE
561
+
562
+
To read documentation for how to build on IBM Z & LinuxONE, [click here](./build-s390x.md)
563
+
560
564
## Notes about GPU-accelerated backends
561
565
562
566
The GPU may still be used to accelerate some parts of the computation even when using the `-ngl 0` option. You can fully disable GPU acceleration by using `--device none`.
0 commit comments