ByteDance-Seed / ByteDance-Seed/Bagel

Think mode on the GenEVAL benchmark

Open
#202 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6.2k
Forks
545
PR merge metrics
No merged PRs in 30d

Description

I cannot find the evaluation code for BAGEL's think mode on the GenEVAL benchmark. How can I reproduce the think mode results for Geneva in the paper?

Contributor guide

No contributing guide indexed for this repository

Research direction

No file or test is named. Search the repository for GenEVAL, Geneva, and “think mode” to locate any evaluation entry point or related documentation, then determine whether the paper’s results can be reproduced from the available code. Done means documenting the required command, configuration, and expected reproduction result, or identifying the missing evaluation code.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.