godofecht / godofecht/flow-scikit

[Bench #478] Add peak RSS, allocation-count and copy-volume parity to canonical benchmarks

Open
#491 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
2
Forks
0
Avg merge
4h 33m
Merged PRs (30d)
9

Description

Parent: #478

Runtime alone is not enough for the claim that Flow beats Python. Add memory evidence beside every representative canonical and scaled workload.

Measure process peak RSS, heap allocation count/bytes where instrumentable, persistent model size, temporary workspace size and explicit matrix/vector copy volume. Separate cold process/import memory from steady estimator execution. Record whether BLAS/native libraries allocate internally when observable.

Acceptance: same-machine Flow/sklearn memory rows for all canonical estimator families; machine-readable fields and Pages plots; regressions can be gated directionally; a runtime win with materially worse memory remains an explicit yellow/red dimension rather than being hidden.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with parent issue #478 and locate the existing canonical and scaled benchmark definitions, then trace how their results become machine-readable data and Pages plots. Determine where memory measurements can be recorded for Flow and sklearn, including the acceptance dimensions listed here. Done means all canonical estimator families have comparable memory rows, plots, and directional regression signals.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.