civiccc / civiccc/suggestomatic

Standardize performance benchmark

Open
#17 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
16
Forks
1
PR merge metrics
No merged PRs in 30d

Description

As we're separating algorithmic changes from performance changes, there should be a standardized way to measure how two different versions perform from a purely performance point of view -- rate, time for full run, etc.

Contributor guide

No contributing guide indexed for this repository

Research direction

No file, test, or entry point is named. Start by surveying the repository for the recommendation algorithm's execution entry points and any existing timing or evaluation tests. Done means documenting and implementing an agreed standard for comparing versions by rate, full-run time, and other performance metrics.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.