huggingface / huggingface/AIEnergyScore

non-docker + non-batch mode isn't using the correct defaults

Open
#17 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
42
Forks
8
PR merge metrics
No merged PRs in 30d

Description

At least for gpt-oss models if you haven't specified reasoning level it the non-batch mode for non-docker script will default to using reasoning High but truncate tokens to max of 100. the non-batch mode should be aligned with the batch mode in terms of defaults and behavior.

Contributor guide

No contributing guide indexed for this repository

Research direction

Compare the non-batch, non-docker execution path with the batch path, focusing first on defaults for gpt-oss models and the token limit. Done means both modes use the same reasoning-level default and do not unexpectedly truncate tokens to 100.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.