godofecht / godofecht/flow-scikit

[Parity #478] Prove estimator hyperparameter, stopping-rule and work-budget equivalence in every performance row

Open
#501 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2
Forks
0
Avg merge
4h 33m
Merged PRs (30d)
9

Description

Parent: #478.

A performance comparison is invalid if Flow and sklearn silently perform different configured work. Extend the parity contract to record and compare every performance-relevant setting: solver/algorithm, regularization, tolerance, max_iter, n_init, n_estimators, max_depth, feature subsampling, bootstrap, kernel/gamma, random seed, convergence/stopping rule and effective iteration/tree/support-vector counts.

Defaults must be materialized rather than assumed, because sklearn defaults can change by version.

Acceptance: each canonical/operation row contains resolved sklearn and Flow config plus effective-work diagnostics; mismatched work budgets are not performance-eligible; version changes that alter sklearn defaults fail/flag contract regeneration; benchmark docs expose deliberate semantic differences rather than hiding them.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with parent issue #478 and trace how canonical/operation performance rows are generated. Identify where sklearn and Flow configurations, defaults, and effective-work diagnostics are recorded, then inspect the benchmark documentation and contract-regeneration checks. Done means rows expose resolved settings and diagnostics, mismatched budgets are excluded, and default changes are flagged.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, scikit-learn
Domain
machine-learning, performance, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.