modelscope / modelscope/ms-swift

视频数据集和图片数据集不同max_length 和 packing与否吗

Open
#6,615 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

stale
Dominant language
Python
Stars
15.7k
Forks
1.7k
Avg merge
1d 16h
Merged PRs (30d)
136

Description

请问ms-swift是否支持:

  1. 视频数据集和图片数据集设置不同max_length, 比如16k和4k
  2. 视频数据集packing=False, 而图片数据集packing=True

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are identified. Start by tracing how video and image datasets are batched and how max_length and packing are read during training, then clarify the expected per-modality behavior with maintainers. Done means the supported configuration is documented and covered by tests for both dataset types.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.