为什么batch设置越多,整体预测速度越慢?
Open
- Dominant language
- Python
- Stars
- 2k
- Forks
- 362
- PR merge metrics
- No merged PRs in 30d
Description
my_senta.init_model(model_class="ernie_1.0_skep_large_ch", task="sentiment_classify", use_cuda=use_cuda)
采用如上初始化方式
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the reported my_senta.init_model(model_class="ernie_1.0_skep_large_ch", task="sentiment_classify", use_cuda=use_cuda) setup and reproduce prediction runs at different batch sizes. Measure end-to-end prediction time and inspect the model's batching path to determine why larger batches slow overall throughput; done means the cause and expected behavior are documented or corrected.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100