OpenGVLab / OpenGVLab/Ask-Anything

请问一下videochat2用的那个answer prompt: best option:(能不能用在商用闭源模型上?

Open
#206 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
3.4k
Forks
268
PR merge metrics
No merged PRs in 30d

Description

我可以在其他开源模型比如videochatgpt、llava-next等模型上成功限制模型的输出,但我用openai的api调gpt4添加一条messages ASSISTANT: Best option( 出来效果并不好,这是因为闭源模型无法删除ASSISTANT末尾的特殊分界token吗?您是怎么用GPT4V在mvbench上评测的?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No file, test, or entry point is named. Start by comparing VideoChat2's answer prompt with the OpenAI GPT-4 message behavior, then review how GPT-4V was evaluated on MVBench. Done would mean documenting whether this prompt works with closed models and explaining the evaluation procedure.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.