ByteDance-Seed / ByteDance-Seed/Bagel

请问edit数据集需要设置is_mandatory: true 吗

Open
#257 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6.2k
Forks
545
PR merge metrics
No merged PRs in 30d

Description

```
t2i_pretrain:
dataset_names:
- t2i
image_transform_args:
image_stride: 16
max_image_size: 1024
min_image_size: 512
is_mandatory: true
num_used_data: # The sum should be larger that NUM_GPUS x NUM_WORKERS
- 10
weight: 1

unified_edit:
dataset_names:
- seedxedit_multi
image_transform_args:
image_stride: 16
max_image_size: 1024
min_image_size: 512
vit_image_transform_args:
image_stride: 14
max_image_size: 518
min_image_size: 224
is_mandatory: false
num_used_data:
- 500
weight: 1

vlm_sft:
dataset_names:
- llava_ov
image_transform_args:
image_stride: 14
max_image_size: 980
min_image_size: 378
max_pixels: 2_007_040
frame_sampler_args:
max_num_frames: 12
min_num_frames: 8
is_mandatory: true
shuffle_lines: True
shuffle_seed: 0
num_used_data:
- 10
weight: 1

```

作者您好!这是我的 yaml。当我把edit部分的is_mandatory设置为true的时候,就会在计算loss时候报错:
```
File "/inspire/hdd/project/aiforquantum/zhengkaipeng-240108120123/old_space/zhengkaipeng-240108120123/weilai/codes/BAGEL/data/data_utils.py", line 38, in create_sparse_mask [rank2]:
document_id = torch.cat([torch.full((l,), i) for i, l in enumerate(document_lens, start=1)]).to(device) [rank2]: ^^^^^^^^^^^^^^^^^^^
[rank2]: RuntimeError: Trying to create tensor with negative dimension -788: [-788]
```

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the provided YAML, especially unified_edit.is_mandatory, and reproduce the failure during loss computation. Then inspect data/data_utils.py at create_sparse_mask line 38, using the document_lens value from the traceback to determine why a negative tensor dimension is produced. Done means establishing whether is_mandatory: true is supported for this dataset and documenting or correcting the configuration path so training completes.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.