GoogleChrome / GoogleChrome/webai-compute-benchmark
Include pipeline initialization (but not model download) in (some) benchmarking step.
Open
- Dominant language
- JavaScript
- Stars
- 14
- Forks
- 6
- PR merge metrics
- No merged PRs in 30d
Description
Can we create a new / multiple `AsyncBenchmarkStep`s, one for this intialization phase, one for (potentially multiple) inferences?
Contributor guide
Research direction
No files or tests are named. Start by tracing the existing AsyncBenchmarkStep usage and benchmark-step setup, then determine which benchmark flows need separate initialization and inference timing while excluding model download. Done means the applicable benchmarks report those phases independently.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript
- Domain
- performance
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100