deepseek-ai / deepseek-ai/DeepSeek-VL2

Parameters

Open
#68 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
5.4k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

Hi, I am wondering how to show the default temperature and top_p for the model.

I think the parameter `do_sample` if set as False, it means temperature=0? how about the value of `top_p`? Therefore, can you share how to check the parameters of the model? Thanks

```
outputs = vl_gpt.language.generate(
inputs_embeds=inputs_embeds,
attention_mask=prepare_inputs.attention_mask,
pad_token_id=tokenizer.eos_token_id,
bos_token_id=tokenizer.bos_token_id,
eos_token_id=tokenizer.eos_token_id,
max_new_tokens=512,
do_sample=True,
use_cache=True,
temperature=0.4,
top_p=0.9
)
```

Thanks

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.