AnswerDotAI / AnswerDotAI/RAGatouille
RAGAtouille cpu only installation
- Dominant language
- Python
- Stars
- 4k
- Forks
- 276
- PR merge metrics
- No merged PRs in 30d
Description
The current ragatouille installation quite heavy right now. For those who only wants to use it on cpu have to unnecessarily install nvidia-cuda based modules. For a production application, where I have to only load and infer from index on cpu doesn't need to install cuda based modules.
Is there a way currently to install only cpu based libraries in ragatouille.
Contributor guide
No contributing guide indexed for this repository
Research direction
No file, test, or entry point is named in the issue. Start by locating the installation dependency configuration, and define completion as a CPU-only installation that avoids NVIDIA CUDA modules while preserving CPU indexing and inference.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100