Phi 3.5 doesn't work
Open
bug
- Dominant language
- TypeScript
- Stars
- 979
- Forks
- 132
- Avg merge
- 9h 23m
- Merged PRs (30d)
- 8
Description
## Describe the bug
I was trying phi 3.5 with this tool but it throws unknown error
## To Reproduce
Steps to reproduce the behavior:
1. Add phi 3.5 to the llm models folder
2. In the Answer tab, select phi 3.5 under models
3. Write a message and click generate
## Expected behavior
Expect the model to respond just like how phi 3 does
## Screenshots

## Environment (please complete the following information):
- OS: Windows11
- GPU: Intel Arc A770 16G
- CPU: Ultra 7 155H
- Version: v1.01b-MTL-H
## Additional context
Contributor guide
Assessment
This issue has not been assessed yet.