Windows build

[ggerganov]

Would be nice if someone can help and provide build instructions for Windows.

I think the only thing that might need an update is the pthread dependency in ggml.c.
The rest of the code should build successfully.

Probably a .bat script to download the models would also be nice since no Bash on Windows.

[kevin01881]

Would love this!! I want to run whisper on my ancient i7-5500U and right now with OpenAI's version on Windows 10, I can only transcribe 100 minutes in 24 hours. ☹️

[trholding]

Here is my recommendation, for x86 windows and multiple targets at once in a single binary format with zero to minimal changes: https://github.com/jart/cosmopolitan

For a demo of what is possible with this: https://redbean.dev/

Info here:

https://justine.lol/cosmopolitan/
https://justine.lol/ape.html

I have used it for small internal projects. And works fine. Basically this is how it works:

Here's how simple it is to get started:

gcc -g -O -static -fno-pie -no-pie -mno-red-zone -nostdlib -nostdinc -o hello.com hello.c \
  -Wl,--oformat=binary -Wl,--gc-sections -Wl,-z,max-page-size=0x1000 -fuse-ld=bfd -gdwarf-4 \
  -Wl,-T,[ape.lds](https://justine.lol/cosmopolitan/ape.lds) -include [cosmopolitan.h](https://justine.lol/cosmopolitan/cosmopolitan.h) [crt.o](https://justine.lol/cosmopolitan/crt.o) [ape.o](https://justine.lol/cosmopolitan/ape.o) [cosmopolitan.a](https://justine.lol/cosmopolitan/cosmopolitan.a)
In the above one-liner, we've basically reconfigured the stock compiler on Linux so it outputs binaries that'll run on MacOS, Windows, FreeBSD, OpenBSD, and NetBSD too. They also boot from the BIOS. Please note this is intended for people who don't care about desktop GUIs, and just want stdio and sockets without devops toil.

Doesn't work if you use libc functions that are not implemented, most are. If you get issues, this is your safe way to mitigate missing headers etc: https://github.com/fabriziobertocci/cosmo-include

Here are more resources to get you started:

https://github.com/shmup/awesome-cosmopolitan

Wish you good fun! I'm sure you'll love it.

Oh by the way. If you have real issues: https://github.com/jart/cosmopolitan/issues the crew is really cool and made up wizards / ex googlers, helpful - they respond quick, try to resolve issues soon.

Cheers

[trholding]

PS. If you go the cosmopolitan way, you could also think of using redbean to encapsulate it and provide a web ui - would be cool.

[ggerganov]

Thanks for the ideas - cosmopolitan sounds like an interesting option! Will give it a thought

[CHERTS]

@ggerganov for Windows there is a POSIX threads API for Windows from - pthreads4w
pthreads4w working for VisualStudio projects

I tried compiling ggml.c in VisualStudio 2017 with pthreads4w, but it didn't work for me :(

[CHERTS]

Hi, i created pull request for adding windows support with build in Visual Studio 2022

@ggerganov please, see my pull request, thank's

[minhngoc25a]

This project has support for the MSVC compiler, so you are able to compile it with Visual Studio. You should use the 2017-2022 versions to ensure compatibility. The "Desktop development with C++" should provide most of the stuff we need to compile.

Launch Developer Command Prompt for whatever version of your VS, then use cmake to build a VS project. In the root directory of the repo, execute this command:

cmake -S . -B ./build

This will tell cmake to take the current directory as a source and generate a VS project inside the build folder. Then, open the solution and Build Solution to build a binary file.

Screenshots

[john0909]

This project has support for the MSVC compiler, so you are able to compile it with Visual Studio. You should use the 2017-2022 versions to ensure compatibility. The "Desktop development with C++" should provide most of the stuff we need to compile.

Launch Developer Command Prompt for whatever version of your VS, then use cmake to build a VS project. In the root directory of the repo, execute this command:

cmake -S . -B ./build

This will tell cmake to take the current directory as a source and generate a VS project inside the build folder. Then, open the solution and Build Solution to build a binary file.

Screenshots

it seems not support VS2017, when I build this with VS2017, many errors display. but It can build succeed on VS2022,Thanks! But when running it, I had this error: Assertion failed:rc==0,file ****\ggml.c,line 6522, I checked the ggml.c,found it failed when create multi thread. any one had the same issue and any idea that can fix it?

[john0909]

Has anyone encountered this problem：

[chidiwilliams]

This project has support for the MSVC compiler, so you are able to compile it with Visual Studio. You should use the 2017-2022 versions to ensure compatibility. The "Desktop development with C++" should provide most of the stuff we need to compile.

Launch Developer Command Prompt for whatever version of your VS, then use cmake to build a VS project. In the root directory of the repo, execute this command:

cmake -S . -B ./build

This will tell cmake to take the current directory as a source and generate a VS project inside the build folder. Then, open the solution and Build Solution to build a binary file.

Screenshots

Trying to get this working with Visual Studio 2022 on Windows as well, but I seem to be stuck on this error when building the solution:

Do you have any possible pointers? I'm not very familiar with building C on Windows.