deepspeedai / deepspeedai/DeepSpeed
RuntimeError: Could not find llvm-config. Please install llvm-{8, 9, 10}-dev
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 43.1k
- Forks
- 5k
- Avg merge
- 4d 15h
- Merged PRs (30d)
- 112
Description
Hi
I am trying to install deepspeed, getting following error with python=3.7, pytroch
pytorch 1.7.1 py3.7_cuda10.2.89_cudnn7.6.5_0 pytorch
torchaudio 0.7.2 py37 pytorch
torchvision 0.8.2 py37_cu102 pytorch
could you please have a look? thanks for your help
(updated) rkarimi@vgne039:/idiap/user/rkarimi/dev/test/transformers/examples/seq2seq$ pip install deepspeed
Collecting deepspeed
Using cached deepspeed-0.3.11-py3-none-any.whl
Requirement already satisfied: tqdm in /remote/idiap.svm/user.active/rkarimi/libs/anaconda3/envs/updated/lib/python3.7/site-packages (from deepspeed) (4.49.0)
Requirement already satisfied: numpy in /remote/idiap.svm/user.active/rkarimi/libs/anaconda3/envs/updated/lib/python3.7/site-packages (from deepspeed) (1.20.0)
Requirement already satisfied: torch>=1.2 in /remote/idiap.svm/user.active/rkarimi/libs/anaconda3/envs/updated/lib/python3.7/site-packages (from deepspeed) (1.7.1)
Requirement already satisfied: torchvision>=0.4.0 in /remote/idiap.svm/user.active/rkarimi/libs/anaconda3/envs/updated/lib/python3.7/site-packages (from deepspeed) (0.8.2)
Collecting tensorboardX==1.8
Using cached tensorboardX-1.8-py2.py3-none-any.whl (216 kB)
Requirement already satisfied: six in /remote/idiap.svm/user.active/rkarimi/libs/anaconda3/envs/updated/lib/python3.7/site-packages (from tensorboardX==1.8->deepspeed) (1.15.0)
Requirement already satisfied: protobuf>=3.2.0 in /remote/idiap.svm/user.active/rkarimi/libs/anaconda3/envs/updated/lib/python3.7/site-packages (from tensorboardX==1.8->deepspeed) (3.14.0)
Collecting triton==0.2.3
Using cached triton-0.2.3.tar.gz (943 kB)
ERROR: Command errored out with exit status 1:
command: /idiap/user/rkarimi/libs/anaconda3/envs/updated/bin/python -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-jj_2sq18/triton_de1e82220fc24007a8a638bfad744289/setup.py'"'"'; __file__='"'"'/tmp/pip-install-jj_2sq18/triton_de1e82220fc24007a8a638bfad744289/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info --egg-base /tmp/pip-pip-egg-info-are3rxak
cwd: /tmp/pip-install-jj_2sq18/triton_de1e82220fc24007a8a638bfad744289/
Complete output (7 lines):
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-install-jj_2sq18/triton_de1e82220fc24007a8a638bfad744289/setup.py", line 97, in <module>
find_llvm()
File "/tmp/pip-install-jj_2sq18/triton_de1e82220fc24007a8a638bfad744289/setup.py", line 28, in find_llvm
raise RuntimeError('Could not find llvm-config. ' + instructions)
RuntimeError: Could not find llvm-config. Please install llvm-{8, 9, 10}-dev
----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the reported pip install deepspeed failure in the Python 3.7 and PyTorch 1.7.1 environment. Start with the triton package's setup.py, especially find_llvm(), and compare its llvm-config detection with the installation output. Done means the dependency installation completes without the reported RuntimeError.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- build-system, machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100