InternLM / InternLM/lmdeploy

[Bug] Why the example/cpp/llama/llama_triton_example.cc does not call the LlamaTritonModel::createEngine()?

Open
#2,803 0 comments 0 reactions 1 assignee Claimed by @lzhangzz View on GitHub
Dominant language
Python
Stars
8.1k
Forks
748
Avg merge
6d 2h
Merged PRs (30d)
54

Description

### Checklist

- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

### Describe the bug

I try to run the cpp example in the example/cpp/llama/llama_triton_example.cc, and I got a runtime error.Then I figure out that the example did not call LlamaTritonModel::createEngine().

### Reproduction

/

### Environment

```Shell
/
```

### Error traceback

```Shell
/
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.