MaartenGr / MaartenGr/KeyBERT

Efficient KeyLLM + KeyBERT - Torch not compiled with CUDA enabled

Open
#207 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4.2k
Forks
385
PR merge metrics
No merged PRs in 30d

Description

Testing out Efficient KeyLLM + KeyBERT in a pipeline, when the code hits the refinement stage using LLM I get error

"Error while extracting keywords from text: Torch not compiled with CUDA enabled"

This line that breaks the code inside extract keywords class - `doc_embeddings = torch.from_numpy(doc_embeddings).float().to("cpu")`


Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the extract keywords class and reproduce the Efficient KeyLLM + KeyBERT pipeline at the refinement stage, focusing on the reported conversion to CPU. Confirm the failure and determine the relevant device-handling path; done means the pipeline no longer raises the CUDA compilation error in the reported scenario.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.