AdiKsOnDev / AdiKsOnDev/PrivateFalcon
Optimisation
Aperta
bug
good first issue
medium
- Lingua principale
- Python
- Stelle
- 1
- Fork
- 0
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
# Problem
Right now script doesn't utilize all the power Falcon-7b offers. It can return very weird answers, repeat the same answer over and over again, and etc.
## Ideas
The problem might be in the number of new tokens in the `main.py` file, or in the size of chunks that are being made in `ingest.py`, or something else. I have tried different values in them and stopped at the most optimal ones I could find.
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Valutazione
Questa issue non è ancora stata valutata.