ByteDance-Seed / ByteDance-Seed/Bagel

Some questions about text generation

Open
#182 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
6.2k
Forks
545
PR merge metrics
No merged PRs in 30d

Description

Dear BAGEL Team,

First of all, I would like to sincerely commend you for your impressive work on the BAGEL model. We greatly appreciate the clarity of your paper and the open access to your codebase—it has been immensely helpful for our own research on multimodal generation.

We've been experimenting with BAGEL in our own benchmarking pipeline, particularly exploring the impact of Chain-of-Thought (CoT) prompting on text generation quality. While we observed some promising improvements, we also noticed a decline in overall text quality after introducing CoT.
| Prompt | BAGEL | BAGEL + CoT |
|------------------------------------------------------------------------|--------------------------------------------------|--------------------------------------------------|
| An agent leaps between rooftops amid explosions. Bold letters announce: "Urban Shadow: Agent in Action". | ![Image](https://github.com/user-attachments/assets/9dc6a9a7-d07e-45a0-b1d1-51315dbebff0) | ![Image](https://github.com/user-attachments/assets/75f5bb66-975e-4b4d-b620-3d1236ae98f3) |
|The tabletop blackboard sits on a bar counter, surrounded by bottles and dim ambient lighting. It can be seen "Happy Hour 5-7 PM" using playful bubble letters, decorative lines, and doodles of cocktail glasses on the tabletop blackboard. | ![Image](https://github.com/user-attachments/assets/e940845d-0c2c-42b8-9306-814224346553) | ![Image](https://github.com/user-attachments/assets/aae1e7fb-3047-4462-b591-6bd94212c8a6) |

The key hyperparameters/settings we used are the same as [inference.ipynb](https://github.com/ByteDance-Seed/Bagel/blob/main/inference.ipynb).

We would be grateful if you could offer any insight or suggest possible solutions.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with inference.ipynb and reproduce the reported BAGEL versus BAGEL + CoT examples using the stated settings. Compare the outputs and identify whether the quality decline is reproducible; the issue does not define a concrete code change or acceptance test.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, python
Domain
ai, machine-learning
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.