baidu / baidu/Senta

为什么batch设置越多,整体预测速度越慢?

Open
#75 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2k
Forks
362
PR merge metrics
No merged PRs in 30d

Description

my_senta.init_model(model_class="ernie_1.0_skep_large_ch", task="sentiment_classify", use_cuda=use_cuda)
采用如上初始化方式

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the reported my_senta.init_model(model_class="ernie_1.0_skep_large_ch", task="sentiment_classify", use_cuda=use_cuda) setup and reproduce prediction runs at different batch sizes. Measure end-to-end prediction time and inspect the model's batching path to determine why larger batches slow overall throughput; done means the cause and expected behavior are documented or corrected.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.