abetlen / abetlen/llama-cpp-python
Load time in the log is much different from real load model time?
Đang mở
- Ngôn ngữ chính
- Python
- Star
- 10.6k
- Fork
- 1.4k
- Chỉ số merge pull request
- Chỉ số pull request đang chờ
Mô tả
I see that load time in the log is much smaller than real load time.
I calculate real oad model time by setting time before and after calling Llama-cpp class. From here, I saw thật, real load model time is much larger than the load time in the log.
Could you help me, what is wrong here? Thank you.
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.