DAMO-NLP-SG / DAMO-NLP-SG/VideoLLaMA2

'vicuna' as model_base

Open
#38 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.3k
Forks
90
PR merge metrics
No merged PRs in 30d

Description

How can we use vicuna as the LLM in inference code. Below is the error message. Thanks.

Screenshot 2024-07-07 at 3 51 32 PM

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue only identifies the inference code, Vicuna as the requested model base, and an attached error screenshot; no file, command, or failing test is named. Start by locating the inference entry point and reproducing the reported error, then verify that Vicuna can be selected as the model base and inference completes successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.