deepseek-ai / deepseek-ai/DeepSeek-VL

dataset format of pretraining stage

Open
#56 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4.2k
Forks
596
PR merge metrics
No merged PRs in 30d

Description

How did you unify the format of pretraining dataset? During supervised fine tuning stage, the training data are curated as question and answer pairs. For caption or detection dataset, I want to know if they follow the same format as sft data, and how to collect questions for these data as they originally only contains ground truth like caption or boxes?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.