Installation stuck on windows

# Prerequisites

Please answer the following questions for yourself before submitting an issue.

- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- [x] I carefully followed the [README.md](https://github.com/abetlen/llama-cpp-python/blob/main/README.md).
- [x] I [searched using keywords relevant to my issue](https://docs.github.com/en/issues/tracking-your-work-with-issues/filtering-and-searching-issues-and-pull-requests) to make sure that I am creating a new issue that is not already open (or closed).
- [x] I reviewed the [Discussions](https://github.com/abetlen/llama-cpp-python/discussions), and have a new bug or useful enhancement to share.

# Expected Behavior

Should build fast without stuck

# Current Behavior

It stuck when building

# Environment and Context

Please provide detailed information about your computer setup. This is important in case the issue is not reproducible except for under certain specific conditions.

* Physical (or virtual) hardware you are using, e.g. for Linux:

amd ryzen 5 4500u
windows 11

* SDK version, e.g. for Linux:

```
python 3.9.0
cmake 3.30.1
MSVC
```

# Failure Information (for bugs)

```console
(venv) PS D:\sherpa-talk> $env:VULKAN_SDK = "C:\VulkanSDK\1.3.290.0"
(venv) PS D:\sherpa-talk> pip install .\llama-cpp-python\
Processing d:\sherpa-talk\llama-cpp-python
Installing build dependencies ... canceled
ERROR: Operation cancelled by user
(venv) PS D:\sherpa-talk> pip install .\llama-cpp-python\ --verbose
Using pip 24.2 from d:\sherpa-talk\venv\lib\site-packages\pip (python 3.9)
Processing d:\sherpa-talk\llama-cpp-python
Running command pip subprocess to install build dependencies
Using pip 24.2 from D:\sherpa-talk\venv\Lib\site-packages\pip (python 3.9)
Collecting scikit-build-core>=0.9.2 (from scikit-build-core[pyproject]>=0.9.2)
Obtaining dependency information for scikit-build-core>=0.9.2 from https://files.pythonhosted.org/packages/20/f0/11b0f09173051647af2e140f68f3d94432c5b41a6ea0d45a43e38ab68192/scikit_build_core-0.10.5-py3-none-any.whl.metadata
Using cached scikit_build_core-0.10.5-py3-none-any.whl.metadata (20 kB)
Collecting exceptiongroup>=1.0 (from scikit-build-core>=0.9.2->scikit-build-core[pyproject]>=0.9.2)
Obtaining dependency information for exceptiongroup>=1.0 from https://files.pythonhosted.org/packages/02/cc/b7e31358aac6ed1ef2bb790a9746ac2c69bcb3c8588b41616914eb106eaf/exceptiongroup-1.2.2-py3-none-any.whl.metadata
Using cached exceptiongroup-1.2.2-py3-none-any.whl.metadata (6.6 kB)
Collecting packaging>=21.3 (from scikit-build-core>=0.9.2->scikit-build-core[pyproject]>=0.9.2)
Obtaining dependency information for packaging>=21.3 from https://files.pythonhosted.org/packages/08/aa/cc0199a5f0ad350994d660967a8efb233fe0416e4639146c089643407ce6/packaging-24.1-py3-none-any.whl.metadata
Using cached packaging-24.1-py3-none-any.whl.metadata (3.2 kB)
Collecting pathspec>=0.10.1 (from scikit-build-core>=0.9.2->scikit-build-core[pyproject]>=0.9.2)
Obtaining dependency information for pathspec>=0.10.1 from https://files.pythonhosted.org/packages/cc/20/ff623b09d963f88bfde16306a54e12ee5ea43e9b597108672ff3a408aad6/pathspec-0.12.1-py3-none-any.whl.metadata
Using cached pathspec-0.12.1-py3-none-any.whl.metadata (21 kB)
Collecting tomli>=1.2.2 (from scikit-build-core>=0.9.2->scikit-build-core[pyproject]>=0.9.2)
Obtaining dependency information for tomli>=1.2.2 from https://files.pythonhosted.org/packages/97/75/10a9ebee3fd790d20926a90a2547f0bf78f371b2f13aa822c759680ca7b9/tomli-2.0.1-py3-none-any.whl.metadata
Using cached tomli-2.0.1-py3-none-any.whl.metadata (8.9 kB)
Using cached scikit_build_core-0.10.5-py3-none-any.whl (164 kB)
Using cached exceptiongroup-1.2.2-py3-none-any.whl (16 kB)
Using cached packaging-24.1-py3-none-any.whl (53 kB)
Using cached pathspec-0.12.1-py3-none-any.whl (31 kB)
Using cached tomli-2.0.1-py3-none-any.whl (12 kB)
Installing collected packages: tomli, pathspec, packaging, exceptiongroup, scikit-build-core
Successfully installed exceptiongroup-1.2.2 packaging-24.1 pathspec-0.12.1 scikit-build-core-0.10.5 tomli-2.0.1
Installing build dependencies ... done
Running command Getting requirements to build wheel
Getting requirements to build wheel ... done
Running command Preparing metadata (pyproject.toml)
*** scikit-build-core 0.10.5 using CMake 3.30.1 (metadata_wheel)
Preparing metadata (pyproject.toml) ... done
Collecting typing-extensions>=4.5.0 (from llama_cpp_python==0.2.89)
Obtaining dependency information for typing-extensions>=4.5.0 from https://files.pythonhosted.org/packages/26/9f/ad63fc0248c5379346306f8668cda6e2e2e9c95e01216d2b8ffd9ff037d0/typing_extensions-4.12.2-py3-none-any.whl.metadata
Using cached typing_extensions-4.12.2-py3-none-any.whl.metadata (3.0 kB)
Link requires a different Python (3.9.0 not in: '>=3.10'): https://files.pythonhosted.org/packages/d1/0f/8d2b5ebb01dc49d20ae0a282d6baff7202b7bf0df8acdd4a6abeffe98070/numpy-2.1.0rc1.tar.gz (from https://pypi.org/simple/numpy/) (requires-python:>=3.10)
Link requires a different Python (3.9.0 not in: '>=3.10'): https://files.pythonhosted.org/packages/54/a4/f8188c4f3e07f7737683588210c073478abcb542048cf4ab6fedad0b458a/numpy-2.1.0.tar.gz (from https://pypi.org/simple/numpy/) (requires-python:>=3.10)
Collecting numpy>=1.20.0 (from llama_cpp_python==0.2.89)
Obtaining dependency information for numpy>=1.20.0 from https://files.pythonhosted.org/packages/52/87/bb45780eb4b9ed1e4710c2f2b42ed7224071aef6f08152f2520df0ec2ee5/numpy-2.0.1-cp39-cp39-win_amd64.whl.metadata
Using cached numpy-2.0.1-cp39-cp39-win_amd64.whl.metadata (60 kB)
Collecting diskcache>=5.6.1 (from llama_cpp_python==0.2.89)
Obtaining dependency information for diskcache>=5.6.1 from https://files.pythonhosted.org/packages/3f/27/4570e78fc0bf5ea0ca45eb1de3818a23787af9b390c0b0a0033a1b8236f9/diskcache-5.6.3-py3-none-any.whl.metadata
Using cached diskcache-5.6.3-py3-none-any.whl.metadata (20 kB)
Collecting jinja2>=2.11.3 (from llama_cpp_python==0.2.89)
Obtaining dependency information for jinja2>=2.11.3 from https://files.pythonhosted.org/packages/31/80/3a54838c3fb461f6fec263ebf3a3a41771bd05190238de3486aae8540c36/jinja2-3.1.4-py3-none-any.whl.metadata
Using cached jinja2-3.1.4-py3-none-any.whl.metadata (2.6 kB)
Collecting MarkupSafe>=2.0 (from jinja2>=2.11.3->llama_cpp_python==0.2.89)
Obtaining dependency information for MarkupSafe>=2.0 from https://files.pythonhosted.org/packages/f6/f8/4da07de16f10551ca1f640c92b5f316f9394088b183c6a57183df6de5ae4/MarkupSafe-2.1.5-cp39-cp39-win_amd64.whl.metadata
Using cached MarkupSafe-2.1.5-cp39-cp39-win_amd64.whl.metadata (3.1 kB)
Using cached diskcache-5.6.3-py3-none-any.whl (45 kB)
Using cached jinja2-3.1.4-py3-none-any.whl (133 kB)
Using cached numpy-2.0.1-cp39-cp39-win_amd64.whl (16.6 MB)
Using cached typing_extensions-4.12.2-py3-none-any.whl (37 kB)
Using cached MarkupSafe-2.1.5-cp39-cp39-win_amd64.whl (17 kB)
Building wheels for collected packages: llama_cpp_python
Running command Building wheel for llama_cpp_python (pyproject.toml)
*** scikit-build-core 0.10.5 using CMake 3.30.1 (wheel)
*** Configuring CMake...
2024-08-24 20:59:52,528 - scikit_build_core - WARNING - Can't find a Python library, got libdir=None, ldlibrary=None, multiarch=None, masd=None
loading initial cache file C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\CMakeInit.txt
-- Building for: Visual Studio 17 2022
-- Selecting Windows SDK version 10.0.22000.0 to target Windows 10.0.22631.
-- The C compiler identification is MSVC 19.40.33812.0
-- The CXX compiler identification is MSVC 19.40.33812.0
-- Detecting C compiler ABI info
-- Detecting C compiler ABI info - done
-- Check for working C compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.40.33807/bin/Hostx64/x64/cl.exe - skipped
-- Detecting C compile features
-- Detecting C compile features - done
-- Detecting CXX compiler ABI info
-- Detecting CXX compiler ABI info - done
-- Check for working CXX compiler: C:/Program Files/Microsoft Visual Studio/2022/Community/VC/Tools/MSVC/14.40.33807/bin/Hostx64/x64/cl.exe - skipped
-- Detecting CXX compile features
-- Detecting CXX compile features - done
-- Found Git: C:/Program Files/Git/cmd/git.exe (found version "2.45.2.windows.1")
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD
-- Performing Test CMAKE_HAVE_LIBC_PTHREAD - Failed
-- Looking for pthread_create in pthreads
-- Looking for pthread_create in pthreads - not found
-- Looking for pthread_create in pthread
-- Looking for pthread_create in pthread - not found
-- Found Threads: TRUE
-- Found OpenMP_C: -openmp (found version "2.0")
-- Found OpenMP_CXX: -openmp (found version "2.0")
-- Found OpenMP: TRUE (found version "2.0")
-- OpenMP found
-- Using llamafile
-- Found Vulkan: C:/VulkanSDK/1.3.290.0/Lib/vulkan-1.lib (found version "1.3.290") found components: glslc glslangValidator
-- Vulkan found
-- Warning: ccache not found - consider installing it for faster compilation or disable this warning with GGML_CCACHE=OFF
-- CMAKE_SYSTEM_PROCESSOR: AMD64
-- CMAKE_GENERATOR_PLATFORM: x64
-- x86 detected
-- Performing Test HAS_AVX_1
-- Performing Test HAS_AVX_1 - Success
-- Performing Test HAS_AVX2_1
-- Performing Test HAS_AVX2_1 - Success
-- Performing Test HAS_FMA_1
-- Performing Test HAS_FMA_1 - Success
-- Performing Test HAS_AVX512_1
-- Performing Test HAS_AVX512_1 - Failed
-- Performing Test HAS_AVX512_2
-- Performing Test HAS_AVX512_2 - Failed
CMake Warning (dev) at CMakeLists.txt:9 (install):
Target llama has PUBLIC_HEADER files but no PUBLIC_HEADER DESTINATION.
Call Stack (most recent call first):
CMakeLists.txt:73 (llama_cpp_python_install_target)
This warning is for project developers. Use -Wno-dev to suppress it.

CMake Warning (dev) at CMakeLists.txt:17 (install):
Target llama has PUBLIC_HEADER files but no PUBLIC_HEADER DESTINATION.
Call Stack (most recent call first):
CMakeLists.txt:73 (llama_cpp_python_install_target)
This warning is for project developers. Use -Wno-dev to suppress it.

CMake Warning (dev) at CMakeLists.txt:9 (install):
Target ggml has PUBLIC_HEADER files but no PUBLIC_HEADER DESTINATION.
Call Stack (most recent call first):
CMakeLists.txt:74 (llama_cpp_python_install_target)
This warning is for project developers. Use -Wno-dev to suppress it.

CMake Warning (dev) at CMakeLists.txt:17 (install):
Target ggml has PUBLIC_HEADER files but no PUBLIC_HEADER DESTINATION.
Call Stack (most recent call first):
CMakeLists.txt:74 (llama_cpp_python_install_target)
This warning is for project developers. Use -Wno-dev to suppress it.

-- Configuring done (13.0s)
-- Generating done (0.2s)
-- Build files have been written to: C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build
*** Building project with Visual Studio 17 2022...
Change Dir: 'C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build'

Run Build Command(s): "C:/Program Files/Microsoft Visual Studio/2022/Community/MSBuild/Current/Bin/amd64/MSBuild.exe" ALL_BUILD.vcxproj /p:Configuration=Release /p:Platform=x64 /p:VisualStudioVersion=17.0 /v:n
MSBuild version 17.10.4+10fbfbf2e for .NET Framework
Build started 24/08/2024 21:00:06.

Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\ALL_BUILD.vcxproj" on node 1 (default targets).
Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\ALL_BUILD.vcxproj" (1) is building "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\ZERO_CHECK.vcxproj" (2) on node 1 (default targets).
PrepareForBuild:
Creating directory "x64\Release\ZERO_CHECK\".
C:\Program Files\Microsoft Visual Studio\2022\Community\MSBuild\Microsoft\VC\v170\Microsoft.CppBuild.targets(541,5): warning MSB8029: The Intermediate directory or Output directory cannot reside under the Temporary directory as it could lead to issues with incremental build. [C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\ZERO_CHECK.vcxproj]
Structured output is enabled. The formatting of compiler diagnostics will reflect the error hierarchy. See https://aka.ms/cpp/structured-output for more details.
Creating directory "x64\Release\ZERO_CHECK\ZERO_CHECK.tlog\".
InitializeBuildStatus:
Creating "x64\Release\ZERO_CHECK\ZERO_CHECK.tlog\unsuccessfulbuild" because "AlwaysCreate" was specified.
Touching "x64\Release\ZERO_CHECK\ZERO_CHECK.tlog\unsuccessfulbuild".
CustomBuild:
1>Checking Build System
FinalizeBuildStatus:
Deleting file "x64\Release\ZERO_CHECK\ZERO_CHECK.tlog\unsuccessfulbuild".
Touching "x64\Release\ZERO_CHECK\ZERO_CHECK.tlog\ZERO_CHECK.lastbuildstate".
Done Building Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\ZERO_CHECK.vcxproj" (default targets).
Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\ALL_BUILD.vcxproj" (1) is building "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\common\build_info.vcxproj" (3) on node 1 (default targets).
PrepareForBuild:
Creating directory "build_info.dir\Release\".
C:\Program Files\Microsoft Visual Studio\2022\Community\MSBuild\Microsoft\VC\v170\Microsoft.CppBuild.targets(541,5): warning MSB8029: The Intermediate directory or Output directory cannot reside under the Temporary directory as it could lead to issues with incremental build. [C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\common\build_info.vcxproj]
Structured output is enabled. The formatting of compiler diagnostics will reflect the error hierarchy. See https://aka.ms/cpp/structured-output for more details.
Creating directory "build_info.dir\Release\build_info.tlog\".
InitializeBuildStatus:
Creating "build_info.dir\Release\build_info.tlog\unsuccessfulbuild" because "AlwaysCreate" was specified.
Touching "build_info.dir\Release\build_info.tlog\unsuccessfulbuild".
CustomBuild:
Generating build details from Git
-- Found Git: C:/Program Files/Git/cmd/git.exe (found version "2.45.2.windows.1")
Building Custom Rule D:/sherpa-talk/llama-cpp-python/vendor/llama.cpp/common/CMakeLists.txt
ClCompile:
C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.40.33807\bin\HostX64\x64\CL.exe /c /nologo /W1 /WX- /diagnostics:column /O2 /Ob2 /D _MBCS /D WIN32 /D _WINDOWS /D NDEBUG /D _CRT_SECURE_NO_WARNINGS /D "CMAKE_INTDIR=\"Release\"" /EHsc /MD /GS /fp:precise /Zc:wchar_t /Zc:forScope /Zc:inline /Fo"build_info.dir\Release\\" /Fd"build_info.dir\Release\build_info.pdb" /external:W1 /Gd /TP /errorReport:queue "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\common\build-info.cpp"
build-info.cpp
Lib:
C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.40.33807\bin\HostX64\x64\Lib.exe /OUT:"build_info.dir\Release\build_info.lib" /NOLOGO /MACHINE:X64 /machine:x64 "build_info.dir\Release\build-info.obj"
build_info.vcxproj -> C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\common\build_info.dir\Release\build_info.lib
FinalizeBuildStatus:
Deleting file "build_info.dir\Release\build_info.tlog\unsuccessfulbuild".
Touching "build_info.dir\Release\build_info.tlog\build_info.lastbuildstate".
Done Building Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\common\build_info.vcxproj" (default targets).
Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\ALL_BUILD.vcxproj" (1) is building "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\examples\llava\llava.vcxproj" (4) on node 1 (default targets).
Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\examples\llava\llava.vcxproj" (4) is building "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\ggml.vcxproj" (5) on node 1 (default targets).
Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\ggml.vcxproj" (5) is building "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\vulkan-shaders\vulkan-shaders-gen.vcxproj" (6) on node 1 (default targets).
PrepareForBuild:
Creating directory "vulkan-shaders-gen.dir\Release\".
C:\Program Files\Microsoft Visual Studio\2022\Community\MSBuild\Microsoft\VC\v170\Microsoft.CppBuild.targets(541,5): warning MSB8029: The Intermediate directory or Output directory cannot reside under the Temporary directory as it could lead to issues with incremental build. [C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\vulkan-shaders\vulkan-shaders-gen.vcxproj]
Structured output is enabled. The formatting of compiler diagnostics will reflect the error hierarchy. See https://aka.ms/cpp/structured-output for more details.
Creating directory "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\bin\Release\".
Creating directory "vulkan-shaders-gen.dir\Release\vulkan-s.088A11F6.tlog\".
InitializeBuildStatus:
Creating "vulkan-shaders-gen.dir\Release\vulkan-s.088A11F6.tlog\unsuccessfulbuild" because "AlwaysCreate" was specified.
Touching "vulkan-shaders-gen.dir\Release\vulkan-s.088A11F6.tlog\unsuccessfulbuild".
CustomBuild:
Building Custom Rule D:/sherpa-talk/llama-cpp-python/vendor/llama.cpp/ggml/src/vulkan-shaders/CMakeLists.txt
ClCompile:
C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.40.33807\bin\HostX64\x64\CL.exe /c /nologo /W1 /WX- /diagnostics:column /O2 /Ob2 /D _MBCS /D WIN32 /D _WINDOWS /D NDEBUG /D _CRT_SECURE_NO_WARNINGS /D GGML_SCHED_MAX_COPIES=4 /D GGML_USE_OPENMP /D GGML_USE_LLAMAFILE /D "CMAKE_INTDIR=\"Release\"" /EHsc /MD /GS /fp:precise /Zc:wchar_t /Zc:forScope /Zc:inline /Fo"vulkan-shaders-gen.dir\Release\\" /Fd"vulkan-shaders-gen.dir\Release\vc143.pdb" /external:W1 /Gd /TP /errorReport:queue "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\vulkan-shaders\vulkan-shaders-gen.cpp"
vulkan-shaders-gen.cpp
MakeDirsForLink:
Creating directory "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\vulkan-shaders\Release\".
Link:
C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.40.33807\bin\HostX64\x64\link.exe /ERRORREPORT:QUEUE /OUT:"C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\bin\Release\vulkan-shaders-gen.exe" /INCREMENTAL:NO /NOLOGO kernel32.lib user32.lib gdi32.lib winspool.lib shell32.lib ole32.lib oleaut32.lib uuid.lib comdlg32.lib advapi32.lib /MANIFEST /MANIFESTUAC:"level='asInvoker' uiAccess='false'" /manifest:embed /PDB:"C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build/bin/Release/vulkan-shaders-gen.pdb" /SUBSYSTEM:CONSOLE /TLBID:1 /DYNAMICBASE /NXCOMPAT /IMPLIB:"C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build/vendor/llama.cpp/ggml/src/vulkan-shaders/Release/vulkan-shaders-gen.lib" /MACHINE:X64 /machine:x64 "vulkan-shaders-gen.dir\Release\vulkan-shaders-gen.obj"
vulkan-shaders-gen.vcxproj -> C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\bin\Release\vulkan-shaders-gen.exe
FinalizeBuildStatus:
Deleting file "vulkan-shaders-gen.dir\Release\vulkan-s.088A11F6.tlog\unsuccessfulbuild".
Touching "vulkan-shaders-gen.dir\Release\vulkan-s.088A11F6.tlog\vulkan-shaders-gen.lastbuildstate".
Done Building Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\vulkan-shaders\vulkan-shaders-gen.vcxproj" (default targets).
C:\Program Files\Microsoft Visual Studio\2022\Community\MSBuild\Microsoft\VC\v170\Microsoft.CppBuild.targets(541,5): warning MSB8029: The Intermediate directory or Output directory cannot reside under the Temporary directory as it could lead to issues with incremental build. [C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\ggml.vcxproj]
Structured output is enabled. The formatting of compiler diagnostics will reflect the error hierarchy. See https://aka.ms/cpp/structured-output for more details.
Creating directory "ggml.dir\Release\ggml.tlog\".
InitializeBuildStatus:
Creating "ggml.dir\Release\ggml.tlog\unsuccessfulbuild" because "AlwaysCreate" was specified.
Touching "ggml.dir\Release\ggml.tlog\unsuccessfulbuild".
CustomBuild:
Generate vulkan shaders
ggml_vulkan: Generating and compiling shaders to SPIR-V
Building Custom Rule D:/sherpa-talk/llama-cpp-python/vendor/llama.cpp/ggml/src/CMakeLists.txt
ClCompile:
C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.40.33807\bin\HostX64\x64\CL.exe /c /I"D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\..\include" /I"D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\." /IC:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src /nologo /W1 /WX- /diagnostics:column /O2 /Ob2 /D _WINDLL /D _MBCS /D WIN32 /D _WINDOWS /D NDEBUG /D GGML_USE_VULKAN /D GGML_SHARED /D GGML_BUILD /D _CRT_SECURE_NO_WARNINGS /D GGML_SCHED_MAX_COPIES=4 /D GGML_USE_OPENMP /D GGML_USE_LLAMAFILE /D _XOPEN_SOURCE=600 /D "CMAKE_INTDIR=\"Release\"" /D ggml_EXPORTS /EHsc /MD /GS /arch:AVX2 /fp:precise /Zc:wchar_t /Zc:forScope /Zc:inline /openmp /std:c11 /Fo"ggml.dir\Release\\" /Fd"ggml.dir\Release\vc143.pdb" /external:W0 /Gd /TC /errorReport:queue /external:I "C:/VulkanSDK/1.3.290.0/Include" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml.c" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml-alloc.c" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml-backend.c" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml-quants.c" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml-aarch64.c"
ggml.c
ggml-alloc.c
ggml-backend.c
ggml-quants.c
ggml-aarch64.c
Generating Code...
C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.40.33807\bin\HostX64\x64\CL.exe /c /I"D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\..\include" /I"D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\." /IC:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src /nologo /W1 /WX- /diagnostics:column /O2 /Ob2 /D _WINDLL /D _MBCS /D WIN32 /D _WINDOWS /D NDEBUG /D GGML_USE_VULKAN /D GGML_SHARED /D GGML_BUILD /D _CRT_SECURE_NO_WARNINGS /D GGML_SCHED_MAX_COPIES=4 /D GGML_USE_OPENMP /D GGML_USE_LLAMAFILE /D _XOPEN_SOURCE=600 /D "CMAKE_INTDIR=\"Release\"" /D ggml_EXPORTS /EHsc /MD /GS /arch:AVX2 /fp:precise /Zc:wchar_t /Zc:forScope /Zc:inline /openmp /Fo"ggml.dir\Release\\" /Fd"ggml.dir\Release\vc143.pdb" /external:W0 /Gd /TP /errorReport:queue /external:I "C:/VulkanSDK/1.3.290.0/Include" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml-vulkan.cpp" "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\ggml-vulkan-shaders.cpp" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\llamafile\sgemm.cpp"
ggml-vulkan.cpp
D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml-vulkan.cpp(2056,17): warning C4297: 'ggml_vk_instance_init': function assumed not to throw an exception but does [C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\ggml.vcxproj]
D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml-vulkan.cpp(2056,17):
__declspec(nothrow), throw(), noexcept(true), or noexcept was specified on the function

D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml-vulkan.cpp(6710,38): warning C4477: 'snprintf' : format string '%ld' requires an argument of type 'long', but variadic argument 2 has type 'size_t' [C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\ggml.vcxproj]
D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\ggml-vulkan.cpp(6710,38):
consider using '%zd' in the format string

ggml-vulkan-shaders.cpp
sgemm.cpp
Generating Code...
MakeDirsForLink:
Creating directory "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\Release\".
PreLinkEvent:
Auto build dll exports
setlocal
cd C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src
if %errorlevel% neq 0 goto :cmEnd
C:
if %errorlevel% neq 0 goto :cmEnd
"C:\Program Files\CMake\bin\cmake.exe" -E __create_def C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build/vendor/llama.cpp/ggml/src/ggml.dir/Release/exports.def C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build/vendor/llama.cpp/ggml/src/ggml.dir/Release//objects.txt
if %errorlevel% neq 0 goto :cmEnd
:cmEnd
endlocal & call :cmErrorLevel %errorlevel% & goto :cmDone
:cmErrorLevel
exit /b %1
:cmDone
if %errorlevel% neq 0 goto :VCEnd
:VCEnd
Link:
C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.40.33807\bin\HostX64\x64\link.exe /ERRORREPORT:QUEUE /OUT:"C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\bin\Release\ggml.dll" /INCREMENTAL:NO /NOLOGO "C:\VulkanSDK\1.3.290.0\Lib\vulkan-1.lib" kernel32.lib user32.lib gdi32.lib winspool.lib shell32.lib ole32.lib oleaut32.lib uuid.lib comdlg32.lib advapi32.lib /DEF:"C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build/vendor/llama.cpp/ggml/src/ggml.dir/Release/exports.def" /MANIFEST /MANIFESTUAC:"level='asInvoker' uiAccess='false'" /manifest:embed /PDB:"C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build/bin/Release/ggml.pdb" /SUBSYSTEM:CONSOLE /TLBID:1 /DYNAMICBASE /NXCOMPAT /IMPLIB:"C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build/vendor/llama.cpp/ggml/src/Release/ggml.lib" /MACHINE:X64 /machine:x64 /DLL ggml.dir\Release\ggml.obj
"ggml.dir\Release\ggml-alloc.obj"
"ggml.dir\Release\ggml-backend.obj"
"ggml.dir\Release\ggml-quants.obj"
"ggml.dir\Release\ggml-vulkan.obj"
"ggml.dir\Release\ggml-vulkan-shaders.obj"
ggml.dir\Release\sgemm.obj
"ggml.dir\Release\ggml-aarch64.obj"
Creating library C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build/vendor/llama.cpp/ggml/src/Release/ggml.lib and object C:/Users/User/AppData/Local/Temp/tmpgt6us9y0/build/vendor/llama.cpp/ggml/src/Release/ggml.exp
ggml.vcxproj -> C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\bin\Release\ggml.dll
FinalizeBuildStatus:
Deleting file "ggml.dir\Release\ggml.tlog\unsuccessfulbuild".
Touching "ggml.dir\Release\ggml.tlog\ggml.lastbuildstate".
Done Building Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\ggml\src\ggml.vcxproj" (default targets).
Project "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\examples\llava\llava.vcxproj" (4) is building "C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\src\llama.vcxproj" (7) on node 1 (default targets).
C:\Program Files\Microsoft Visual Studio\2022\Community\MSBuild\Microsoft\VC\v170\Microsoft.CppBuild.targets(541,5): warning MSB8029: The Intermediate directory or Output directory cannot reside under the Temporary directory as it could lead to issues with incremental build. [C:\Users\User\AppData\Local\Temp\tmpgt6us9y0\build\vendor\llama.cpp\src\llama.vcxproj]
Structured output is enabled. The formatting of compiler diagnostics will reflect the error hierarchy. See https://aka.ms/cpp/structured-output for more details.
Creating directory "llama.dir\Release\llama.tlog\".
InitializeBuildStatus:
Creating "llama.dir\Release\llama.tlog\unsuccessfulbuild" because "AlwaysCreate" was specified.
Touching "llama.dir\Release\llama.tlog\unsuccessfulbuild".
CustomBuild:
Building Custom Rule D:/sherpa-talk/llama-cpp-python/vendor/llama.cpp/src/CMakeLists.txt
ClCompile:
C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.40.33807\bin\HostX64\x64\CL.exe /c /I"D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\src\." /I"D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\src\..\include" /I"D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\ggml\src\..\include" /nologo /W1 /WX- /diagnostics:column /O2 /Ob2 /D _WINDLL /D _MBCS /D WIN32 /D _WINDOWS /D NDEBUG /D LLAMA_SHARED /D LLAMA_BUILD /D _CRT_SECURE_NO_WARNINGS /D GGML_USE_VULKAN /D "CMAKE_INTDIR=\"Release\"" /D llama_EXPORTS /EHsc /MD /GS /fp:precise /Zc:wchar_t /Zc:forScope /Zc:inline /Fo"llama.dir\Release\\" /Fd"llama.dir\Release\vc143.pdb" /external:W1 /Gd /TP /errorReport:queue "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\src\llama.cpp" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\src\llama-vocab.cpp" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\src\llama-grammar.cpp" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\src\llama-sampling.cpp" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\src\unicode.cpp" "D:\sherpa-talk\llama-cpp-python\vendor\llama.cpp\src\unicode-data.cpp"
llama.cpp
llama-vocab.cpp
llama-grammar.cpp
llama-sampling.cpp
unicode.cpp
unicode-data.cpp
Generating Code...
```

# Steps to Reproduce

```console
$env:VULKAN_SDK = "C:\VulkanSDK\1.3.290.0"
$env:CMAKE_ARGS="-DGGML_VULKAN=ON"
git clone https://github.com/abetlen/llama-cpp-python
pip install .\llama-cpp-python
```

https://github.com/ggerganov/llama.cpp/tree/1731d4238f9e4f925a750810e7f5480827c66dcf

With original llama.cpp it builds fast without errors with vulkan.

If more information is needed let me know.
By the way I think that the issue template should be improved... it has too many things and it's not simplified.

Happens also without vulkan