You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
docs(mac): improve documentation for mac build (#1873)
* docs(mac): Improve documentation for mac build
- added documentation to build from current master
- added troubleshooting information
Signed-off-by: Sebastian <[email protected]>
* docs(max): fix typo
Signed-off-by: Sebastian <[email protected]>
---------
Signed-off-by: Sebastian <[email protected]>
If you encounter errors regarding a missing utility metal, install `Xcode` from the App Store.
156
+
If completions are slow, ensure that `gpu-layers` in your model yaml matches the number of layers from the model in use (or simply use a high number such as 256).
157
+
If you a get a compile error: `error: only virtual member functions can be marked 'final'`, reinstall all the necessary brew packages, clean the build, and try again.
158
+
159
+
```
160
+
# reinstall build dependencies
161
+
brew reinstall abseil cmake go grpc protobuf wget
162
+
163
+
make clean
150
164
165
+
make build
166
+
```
151
167
152
168
**Requirements**: OpenCV, Gomp
153
169
@@ -239,13 +255,12 @@ make BUILD_TYPE=sycl_f32 build # for float32
239
255
#### Metal (Apple Silicon)
240
256
241
257
```
242
-
make BUILD_TYPE=metal build
258
+
make build
243
259
244
-
# Set `gpu_layers: 1` to your YAML model config file and `f16: true`
245
-
# Note: only models quantized with q4_0 are supported!
260
+
# correct build type is automatically used on mac (BUILD_TYPE=metal)
261
+
# Set `gpu_layers: 256` (or equal to the number of model layers) to your YAML model config file and `f16: true`
246
262
```
247
263
248
-
249
264
### Windows compatibility
250
265
251
266
Make sure to give enough resources to the running container. See https://github.com/go-skynet/LocalAI/issues/2
0 commit comments