AdiKsOnDev / AdiKsOnDev/PrivateFalcon
Optimisation
Abierto
bug
good first issue
medium
- Lenguaje dominante
- Python
- Estrellas
- 1
- Forks
- 0
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
# Problem
Right now script doesn't utilize all the power Falcon-7b offers. It can return very weird answers, repeat the same answer over and over again, and etc.
## Ideas
The problem might be in the number of new tokens in the `main.py` file, or in the size of chunks that are being made in `ingest.py`, or something else. I have tried different values in them and stopped at the most optimal ones I could find.
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Evaluación
Este issue todavía no se ha evaluado.