huggingface / huggingface/transformers.js-benchmarking
[Feature Request] Single pipeline and model test support
Open
- Dominant language
- JavaScript
- Stars
- 17
- Forks
- 5
- PR merge metrics
- No merged PRs in 30d
Description
The Transformers.js Benchmark supports PipelineTestSuite and ModelTestSuite and can run them separately, is it possible to add a feature of running only a specific pipeline or model?
1. It will help to analyze/profile the performance for specific model.
2. When encounter the error of failed to execute 'mapAsync' on 'GPUBuffer or memory access out of bounds for one test, currently it will not move to next pipeline or model test.
@xenova PTAL, thanks!
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.