modelscope / modelscope/ms-swift
多图检查所见生成，想第一阶段此任务进行预训练，然后再利用指令进行微调。请问第一阶段的数据集构造格式如下是否正确？
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 15.7k
- Forks
- 1.7k
- Avg merge
- 1d 16h
- Merged PRs (30d)
- 136
Description
多图检查所见生成，想第一阶段此任务进行预训练，然后再利用指令进行微调。请问第一阶段的数据集构造格式如下是否正确？
{ "messages": [ { "role": "assistant", "content": "<image><image><image>左心室壁厚度正常，运动协调，EF值约60%。主动脉瓣开放良好，无反流。二尖瓣前叶活动度正常，未见脱垂。" } ], "images": [ "/data/echo/left_ventricle.png", "/data/echo/aortic_valve.png", "/data/echo/mitral_valve.png" ] }
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No source files or tests are named. Start by locating the multimodal dataset schema and the data-loading entry point in the repository, then compare the proposed messages and images fields with the supported training stages. Done means the required format and whether this example is accepted are clearly established.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100