DAMO-NLP-SG / DAMO-NLP-SG/VideoLLaMA3

The model does not follow the instructions

Open
#6 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1.2k
Forks
89
PR merge metrics
No merged PRs in 30d

Description

Hello, I would like to know if, in order for the model to follow the instructions, I need to change any parameters or create a different prompt. At the moment, any instruction I add is not respected. Here is an example of a prompt. Or do I need to add a custom system prompt?

Temperature: 0.2

Prompt:

```
Please provide a detailed description of the video, focusing on:

- The viewing angle (front, side, back, etc.)
- The position and orientation of the subject/object
- Notable details or actions visible
- Background or environment elements
- Other relevant visual details.

Additional Instructions to Follow:
- Start your final description with the word 'l0f1'
```

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no source files, tests, or entry points. Start by reproducing the provided video-description prompt with the stated temperature, then determine whether the model or its prompting interface supports a custom system prompt; done would require a confirmed explanation or documented fix for enforcing the requested opening word.

Written by the indexing model from the issue text.

Assessment

Domain
ai
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.