mlcommons / mlcommons/inference
[Llama2-70] No matching distribution found for torch==2.2.0.dev20231006+cpu
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 650
- Avg merge
- 1d 22h
- Merged PRs (30d)
- 6
Description
The pip command to install the correct pytorch version for Llama2-70b fails with this message:
ERROR: Could not find a version that satisfies the requirement torch==2.2.0.dev20231006+cpu (from versions: none)
ERROR: No matching distribution found for torch==2.2.0.dev20231006+cpu
See the output below:
~]$ conda create -n llama2-70b python=3.9
~]$ conda activate llama2-70b
(llama2-70b) ~]$ conda install pybind11==2.10.4 -c conda-forge -y
(llama2-70b) ~]$ python -m pip install torch==2.2.0.dev20231006+cpu --index-url https://download.pytorch.org/whl/nightly/cpu
Looking in indexes: https://download.pytorch.org/whl/nightly/cpu
ERROR: Could not find a version that satisfies the requirement torch==2.2.0.dev20231006+cpu (from versions: none)
ERROR: No matching distribution found for torch==2.2.0.dev20231006+cpu
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the Llama2-70b setup instructions and the pinned torch requirement, then reproduce the pip command in the Python 3.9 conda environment shown. Done means the documented installation command resolves a compatible PyTorch package from the specified nightly CPU index.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100