AnswerDotAI / AnswerDotAI/RAGatouille
How to do Indexing using from_index() on CPU only?
Open
question
- Dominant language
- Python
- Stars
- 4k
- Forks
- 276
- PR merge metrics
- No merged PRs in 30d
Description
What should be the number of n_gpu parameter if I want to run the retriever model and load index on CPU RAM?
Any help will be appreciated.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the from_index() entry point and reading how its n_gpu option is handled for the retriever model and index loading. Document the CPU-only configuration and verify that the guidance clearly explains how to keep the index in CPU RAM.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning, search
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100