godofecht / godofecht/flow-scikit

[Perf #478] RandomForest Digits: remove per-tree training overhead and improve scaling

Open
#483 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2
Forks
0
Avg merge
4h 33m
Merged PRs (30d)
9

Description

Parent: #478

Canonical v2 Digits: Flow fit 93.14 ms vs sklearn 28.95 ms; Flow predict 0.608 ms vs sklearn 0.919 ms. Prediction already wins; training is the entire regression. Iris end-to-end wins ~9.9x.

Profile bootstrap/sample generation, RNG, per-tree setup, tree fit, feature subsampling, allocation/free, tree storage and opportunities for parallel or batched work. Reuse #482 findings where the tree builder is shared.

Acceptance: tree-by-tree timing and allocation profile; distinguish forest orchestration from tree-core cost; scaled n_estimators/sample/feature sweeps; preserve bootstrap/RNG semantics and learned-state diagnostics; Digits fit >=0.95x first, target >=1.05x, without sacrificing the current prediction win.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by profiling RandomForest Digits training across bootstrap/sample generation, RNG, per-tree setup, tree fitting, feature subsampling, allocation, and tree storage. Reuse findings from issue #482 to separate forest orchestration from shared tree-core cost, then run the requested estimator, sample, and feature sweeps. Done means the timing and allocation profile is documented, semantics and diagnostics are preserved, and Digits fit reaches at least 0.95x without losing the prediction win.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, scikit-learn
Domain
machine-learning, performance
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.