AnswerDotAI / AnswerDotAI/byaldi

Getting "Torch not compiled with CUDA enabled error"

Open
#84 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
851
Forks
91
PR merge metrics
No merged PRs in 30d

Description

I have CPU based windows system and while running the below code I get the "Torch not compiled with CUDA enabled error".

Code:-
RAG = RAGMultiModalModel.from_pretrained("vidore/colpali")

Error:-
---------------------------------------------------------------------------
AssertionError Traceback (most recent call last)
Cell In[20], [line 1](vscode-notebook-cell:?execution_count=20&line=1)
----> [1](vscode-notebook-cell:?execution_count=20&line=1) RAG = RAGMultiModalModel.from_pretrained("vidore/colpali")

File ~\AppData\Roaming\Python\Python310\site-packages\byaldi\RAGModel.py:59, in RAGMultiModalModel.from_pretrained(cls, pretrained_model_name_or_path, index_root, device, verbose)
[49](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:49) """Load a ColPali model from a pre-trained checkpoint.
[50](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:50)
[51](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:51) Parameters:
(...)
[56](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:56) cls (RAGMultiModalModel): The current instance of RAGMultiModalModel, with the model initialised.
[57](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:57) """
[58](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:58) instance = cls()
---> [59](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:59) instance.model = ColPaliModel.from_pretrained(
[60](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:60) pretrained_model_name_or_path,
[61](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:61) index_root=index_root,
[62](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:62) device=device,
[63](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:63) verbose=verbose,
[64](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:64) )
[65](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/RAGModel.py:65) return instance

File ~\AppData\Roaming\Python\Python310\site-packages\byaldi\colpali.py:209, in ColPaliModel.from_pretrained(cls, pretrained_model_name_or_path, n_gpu, verbose, device, index_root, **kwargs)
[199](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/colpali.py:199) @classmethod
[200](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/colpali.py:200) def from_pretrained(
[201](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/byaldi/colpali.py:201) cls,
...
[312](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/torch/cuda/__init__.py:312) raise AssertionError(
[313](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/torch/cuda/__init__.py:313) "libcudart functions unavailable. It looks like you have a broken build?"
[314](https://file+.vscode-resource.vscode-cdn.net/c%3A/Users/dksinha/GenAI/~/AppData/Roaming/Python/Python310/site-packages/torch/cuda/__init__.py:314) )

**AssertionError: Torch not compiled with CUDA enabled**

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.