AIAnytime / AIAnytime/ChatCSV-Llama2-Chatbot
Number of tokens (757) exceeded maximum context length (512).
Ouverte
- Langage dominant
- Python
- Étoiles
- 67
- Forks
- 38
- Métriques de merge des PR
- Aucune PR mergée en 30 j
Description
hi, trying to build this app in local, and used same model llama-2-7b-chat.ggmlv3.q8_0.bin
when run the app UI showing some random message same like you showed but checking in console getting this below message:
Number of tokens (755) exceeded maximum context length (512).
Number of tokens (756) exceeded maximum context length (512).
Number of tokens (757) exceeded maximum context length (512).
so increased max_new_tokens=2048, and increased n_ctx and added truncate=True , non of them are fixing this issue.
Changed the model as well. still same issue.
do you know any solution for this issue?
Guide de contribution
Aucun guide de contribution indexé pour ce dépôt
Évaluation
Cette issue n'a pas encore été évaluée.