a16z-infra / a16z-infra/llama2-chatbot
How can I add another model and execute it?
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 219
- PR merge metrics
- No merged PRs in 30d
Description
well, I want to add a model 7b, actually I'm not very interested in Llama
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue asks to add a new 7B model, but does not specify which model or provide any details on the required changes. First, examine the project's model loading and configuration code, likely in files like app.py or a models/ directory. Understand how the current LLaMA v2 integration works, then research how to integrate a different model architecture (like another 7B model) into the existing chatbot framework. 'Done' means the new model can be selected and run through the chatbot interface.
Written by the indexing model from the issue text.
Assessment
- Domain
- ai
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100