InseeFrLab / InseeFrLab/auto-tuning-vllm

Optuna re-suggests identical parameter combinations and marks them as FAIL

Open
#33 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6
Forks
0
Avg merge
34m
Merged PRs (30d)
2

Description

## Problem

Optuna can suggest the same parameter set as a previous trial (including successful ones). Today we only skip failed/pruned duplicates, and we mark them as `FAIL` — wasting GPU time and polluting the study.

## Expected behavior

- Skip exact duplicates already present in the study (configurable via `optimization.no_repeat`, default `true`).
- Record skips as **PRUNED** (`skip_reason: duplicate_parameters`), not **FAIL**.
- Stop early when the search space is exhausted (grid / small discrete spaces).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.