For tens of millions of data, how to use GPU to accelerate the KeyBERT algorithm?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.2k
- Forks
- 385
- PR merge metrics
- No merged PRs in 30d
Description
Hello author, since I have millions of documents, I want to use GPU to accelerate the computation of the KeyBERT algorithm, especially during the embedding phase. However, I don’t see a place to set the batch_size parameter. Are there any methods to speed up the computation? Thank you.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the embedding phase in KeyBERT and reviewing how the current embedding backend is configured. Investigate whether batching and GPU selection are exposed, then define the supported approach for millions of documents. Done should include a documented, usable acceleration path and coverage for the new configuration.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100