a16z-infra / a16z-infra/llama2-chatbot

How can I add another model and execute it?

Open
#31 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.4k
Forks
219
PR merge metrics
No merged PRs in 30d

Description

well, I want to add a model 7b, actually I'm not very interested in Llama

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue asks to add a new 7B model, but does not specify which model or provide any details on the required changes. First, examine the project's model loading and configuration code, likely in files like app.py or a models/ directory. Understand how the current LLaMA v2 integration works, then research how to integrate a different model architecture (like another 7B model) into the existing chatbot framework. 'Done' means the new model can be selected and run through the chatbot interface.

Written by the indexing model from the issue text.

Assessment

Domain
ai
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.