benchopt / benchopt/benchmark_resnet_classif

Rewrite the run function of solvers to make it more testable

Open
#41 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
12
Forks
4
PR merge metrics
No merged PRs in 30d

Description

Currently the model consistency test rewrites a lot of what is done in the run function of the solvers.
It would be nice to refactor that to have the model consistency test be as close as possible to what is done in the solvers.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the solvers' run functions and the model consistency test, then compare the duplicated steps between them. Refactor the shared behavior so the consistency test follows the solver execution more closely, and confirm the model consistency test still passes.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, testing-qa
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.