bytedance / bytedance/1d-tokenizer

Effect of `randomize_temperature` on gFID of RAR

Open
#74 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1.2k
Forks
70
PR merge metrics
No merged PRs in 30d

Description

Hi,

Did you conduct any ablation studies on the effect of `randomize_temperature` on gFID? For instance, if you use a very low `randomize_temperature` (equivalent to `argmax`), does the gFID improve or worsen?

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue does not name any files, tests, or entry points. Investigate how randomize_temperature is configured and evaluated, compare a very low value with the existing setting, and report whether gFID improves or worsens.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.