AnswerDotAI / AnswerDotAI/RAGatouille
Indexing on Mac: using 'mps' device?
- Dominant language
- Python
- Stars
- 4k
- Forks
- 276
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
just installed RAGatouille on my mac and tried to create an index. It worked.
However, output shows several warnings:
> UserWarning: torch.cuda.amp.GradScaler is enabled, but CUDA is not available. Disabling.
So does it use the Apple M2 chip, or the GPU? How to use the torch.device('mps') ?
TIA
Contributor guide
No contributing guide indexed for this repository
Research direction
Reproduce index creation on a Mac with an Apple M2 and inspect the CUDA warning and device-selection path used by RAGatouille. Determine whether torch.device('mps') is supported for indexing, then document the required behavior or configuration and verify that indexing completes without the CUDA warning.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100