Dolly not using GPU
Nobody has claimed this yet.
- Dominant language
- HTML
- Stars
- 1.5k
- Forks
- 120
- PR merge metrics
- No merged PRs in 30d
Description
I ran into the issue you hit where the GPU isn't being used by pytorch.
First you need to find out which version on cuda is installed, then you need to install pytorch kind of like this:
sudo pip install torch==1.12.1+cu113 --extra-index-url https://download.pytorch.org/whl/cu113
Change the torch version to what you want and change the cuda version to match what's installed in your environment
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no repository file or test; it describes a PyTorch installation workaround for Dolly not using the GPU. First verify the installed CUDA version and the matching PyTorch package, then identify where this setup guidance belongs. Done means a clear note covering the matching torch and CUDA versions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- pytorch
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100