Could not install llama-cpp-python 0.3.7 on Macbook Air M1 - Compilation issue

# Prerequisites

Please answer the following questions for yourself before submitting an issue.

- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- [x] I carefully followed the [README.md](https://github.com/abetlen/llama-cpp-python/blob/main/README.md).
- [x] I [searched using keywords relevant to my issue](https://docs.github.com/en/issues/tracking-your-work-with-issues/filtering-and-searching-issues-and-pull-requests) to make sure that I am creating a new issue that is not already open (or closed).
- [x] I reviewed the [Discussions](https://github.com/abetlen/llama-cpp-python/discussions), and have a new bug or useful enhancement to share.

# Expected Behavior

The installation should be done correctly with:

```
pip install llama-cpp-python==0.3.7
# Or
pip install llama-cpp-python \c
--extra-index-url https://abetlen.github.io/llama-cpp-python/whl/cpu
```

# Current Behavior

Error logs: [https://gist.github.com/vietanhdev/c641ec7c4acc8fd9d5f0f3a02a850189](https://gist.github.com/vietanhdev/c641ec7c4acc8fd9d5f0f3a02a850189)

I think this part caused the issue:

```
[31/66] : && /opt/homebrew/opt/llvm/bin/clang -O3 -DNDEBUG -arch arm64 -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX15.2.sdk -dynamiclib -Wl,-headerpad_max_install_names -o bin/libggml-metal.dylib -install_name @rpath/libggml-metal.dylib vendor/llama.cpp/ggml/src/ggml-metal/CMakeFiles/ggml-metal.dir/ggml-metal.m.o vendor/llama.cpp/ggml/src/ggml-metal/CMakeFiles/ggml-metal.dir/__/__/__/__/__/autogenerated/ggml-metal-embed.s.o -Wl,-rpath,@loader_path bin/libggml-base.dylib -framework Foundation -framework Metal -framework MetalKit && :
FAILED: bin/libggml-metal.dylib
: && /opt/homebrew/opt/llvm/bin/clang -O3 -DNDEBUG -arch arm64 -isysroot /Applications/Xcode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX15.2.sdk -dynamiclib -Wl,-headerpad_max_install_names -o bin/libggml-metal.dylib -install_name @rpath/libggml-metal.dylib vendor/llama.cpp/ggml/src/ggml-metal/CMakeFiles/ggml-metal.dir/ggml-metal.m.o vendor/llama.cpp/ggml/src/ggml-metal/CMakeFiles/ggml-metal.dir/__/__/__/__/__/autogenerated/ggml-metal-embed.s.o -Wl,-rpath,@loader_path bin/libggml-base.dylib -framework Foundation -framework Metal -framework MetalKit && :
Undefined symbols for architecture arm64:
"_OBJC_CLASS_$_MTLResidencySetDescriptor", referenced from:
in ggml-metal.m.o
ld: symbol(s) not found for architecture arm64
clang: error: linker command failed with exit code 1 (use -v to see invocation)
```

The installation works well with version 0.3.6.

# Environment and Context

- Macbook Air M1 - OS version: 15.3.1.
- Environment: Miniconda3, tried with Python 3.10 and 3.11.
- sw_vers
ProductName: macOS
ProductVersion: 15.3.1
BuildVersion: 24D70
- xcodebuild -version
Xcode 16.2
- xcrun -sdk macosx --show-sdk-version
15.2

# Failure Information (for bugs)

Please help provide information about the failure if this is a bug. If it is not a bug, please remove the rest of this template.

# Steps to Reproduce

- Install Miniconda3
- Create a new environment and install the package:

```
conda create -n llama-cpp python=3.10 # or 3.11
conda activate llama-cpp
pip install llama-cpp-python==0.3.7
```