abetlen / abetlen/llama-cpp-python
Load time in the log is much different from real load model time?
Aperta
- Lingua principale
- Python
- Stelle
- 10.6k
- Fork
- 1.4k
- Metriche di merge delle PR
- Metriche PR in attesa
Descrizione
I see that load time in the log is much smaller than real load time.
I calculate real oad model time by setting time before and after calling Llama-cpp class. From here, I saw thật, real load model time is much larger than the load time in the log.
Could you help me, what is wrong here? Thank you.
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.