THUDM / THUDM/slime

[Question] 多模态数据加载巨慢

Open
#1,804 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

question
Dominant language
Python
Stars
8.5k
Forks
1.3k
Avg merge
5h 36m
Merged PRs (30d)
22

Description

Your Question

请问有人遇到过多模态单轮训练数据加载非常慢点情况吗?我使用geo3k的脚本去训练virl-39k数据集,发现多模态数据加载会卡在这个地方很长时间。有无有效的解决方案 非常感谢~

Image
What I've Tried

None

Environment (if relevant)

镜像是:dockerhub/slimerl/slime:v0.2.4

Additional Context

No response

Pre-submission Checklist

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the slow multimodal data loading with the geo3k script, the virl-39k dataset, and the dockerhub/slimerl/slime:v0.2.4 image. Inspect the loading stage where the run stalls and compare its behavior with the reported screenshot. Done means identifying a supported cause and documenting an effective solution or workaround.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.