abetlen / abetlen/llama-cpp-python

error: no matching function for call to 'ggml_group_norm'

Open
#1,665 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
10.6k
Forks
1.4k
PR merge metrics
PR metrics pending

Description

# Prerequisites

Please answer the following questions for yourself before submitting an issue.

- [x] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
- [x] I carefully followed the [README.md](https://github.com/abetlen/llama-cpp-python/blob/main/README.md).
- [x] I [searched using keywords relevant to my issue](https://docs.github.com/en/issues/tracking-your-work-with-issues/filtering-and-searching-issues-and-pull-requests) to make sure that I am creating a new issue that is not already open (or closed).
- [x] I reviewed the [Discussions](https://github.com/abetlen/llama-cpp-python/discussions), and have a new bug or useful enhancement to share.

Fails to build when *VULKAN* options are enabled in llama-cpp:
```
/usr/ports/misc/py-llama-cpp-python/work-py311/llama-cpp-python-0.2.87/vendor/llama.cpp/ggml/src/ggml-vulkan.cpp:7112:24: error: no matching function for call to 'ggml_group_norm'
7112 | tensor_clone = ggml_group_norm(ggml_ctx, src0_clone, *(int *)tensor->op_params);
| ^~~~~~~~~~~~~~~
/usr/ports/misc/py-llama-cpp-python/work-py311/llama-cpp-python-0.2.87/vendor/llama.cpp/ggml/src/../include/ggml.h:1143:35: note: candidate function not viable: requires 4 arguments, but 3 were provided
1143 | GGML_API struct ggml_tensor * ggml_group_norm(
| ^
1144 | struct ggml_context * ctx,
| ~~~~~~~~~~~~~~~~~~~~~~~~~~
1145 | struct ggml_tensor * a,
| ~~~~~~~~~~~~~~~~~~~~~~~~
1146 | int n_groups,
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1147 | float eps);
| ~~~~~~~~~~~~~~~~~~~~~~~~~
7 warnings and 1 error generated.
```

Version: 0.2.87
llama.cpp rev. be55695
FreeBSD 14.1

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.