alibaba / alibaba/EfficientAI

missing data/jsonls/omnibench.jsonl

Open
#7 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
51
Forks
8
PR merge metrics
No merged PRs in 30d

Description

Dear authors,

Thanks for open-sourcing this interesting research.

I would like to reproduce the result of Qwen-Omni quantization.

However, I couldn't recognize what `omnibench.jsonl` file is. It looks customized dataset, which differs from the jsonl file in the omnibench github. https://github.com/multimodal-art-projection/OmniBench/blob/main/dataset/batch-5_1142_20240817.jsonl

Can you share it?

Thanks.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by checking whether data/jsonls/omnibench.jsonl exists and compare it with the linked OmniBench batch-5_1142_20240817.jsonl file. Trace the Qwen-Omni quantization reproduction inputs to determine the expected dataset, then make sure the requested file is available and matches the documented reproduction workflow.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, machine-learning
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
58/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.