godofecht / godofecht/flow-scikit
[Parity #478] Prove estimator hyperparameter, stopping-rule and work-budget equivalence in every performance row
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 2
- Forks
- 0
- Avg merge
- 4h 33m
- Merged PRs (30d)
- 9
Description
Parent: #478.
A performance comparison is invalid if Flow and sklearn silently perform different configured work. Extend the parity contract to record and compare every performance-relevant setting: solver/algorithm, regularization, tolerance, max_iter, n_init, n_estimators, max_depth, feature subsampling, bootstrap, kernel/gamma, random seed, convergence/stopping rule and effective iteration/tree/support-vector counts.
Defaults must be materialized rather than assumed, because sklearn defaults can change by version.
Acceptance: each canonical/operation row contains resolved sklearn and Flow config plus effective-work diagnostics; mismatched work budgets are not performance-eligible; version changes that alter sklearn defaults fail/flag contract regeneration; benchmark docs expose deliberate semantic differences rather than hiding them.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with parent issue #478 and trace how canonical/operation performance rows are generated. Identify where sklearn and Flow configurations, defaults, and effective-work diagnostics are recorded, then inspect the benchmark documentation and contract-regeneration checks. Done means rows expose resolved settings and diagnostics, mismatched budgets are excluded, and default changes are flagged.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, scikit-learn
- Domain
- machine-learning, performance, testing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100