NVIDIA / NVIDIA/apex

Install issue

Open
#645 3 comments 4 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
9k
Forks
1.5k
Avg merge
2d 4h
Merged PRs (30d)
3

Description

Use pip to install and have this problem
pip install -v --no-cache-dir --global-option="--cpp_ext" --global-option="--cuda_ext" ./

UserWarning: Disabling all use of wheels due to the use of --build-options / --global-options / --install-options.
cmdoptions.check_install_build_global(options)
Created temporary directory: /tmp/pip-ephem-wheel-cache-k67c8pkr
Created temporary directory: /tmp/pip-req-tracker-vy9ko0xu
Created requirements tracker '/tmp/pip-req-tracker-vy9ko0xu'
Created temporary directory: /tmp/pip-install-iqib0ju5
Processing /home/yeliu/apex
Created temporary directory: /tmp/pip-req-build-ogbew814
Added file:///home/yeliu/apex to build tracker '/tmp/pip-req-tracker-vy9ko0xu'
Running setup.py (path:/tmp/pip-req-build-ogbew814/setup.py) egg_info for package from file:///home/yeliu/apex
Running command python setup.py egg_info

Warning: Torch did not find available GPUs on this system.
 If your intention is to cross-compile, this is not an error.
By default, Apex will cross-compile for Pascal (compute capabilities 6.0, 6.1, 6.2),
Volta (compute capability 7.0), and Turing (compute capability 7.5).
If you wish to cross-compile for a single specific architecture,
export TORCH_CUDA_ARCH_LIST="compute capability" before running setup.py.

torch.__version__  =  1.3.1
running egg_info
creating /tmp/pip-req-build-ogbew814/pip-egg-info/apex.egg-info
writing /tmp/pip-req-build-ogbew814/pip-egg-info/apex.egg-info/PKG-INFO
writing dependency_links to /tmp/pip-req-build-ogbew814/pip-egg-info/apex.egg-info/dependency_links.txt
writing top-level names to /tmp/pip-req-build-ogbew814/pip-egg-info/apex.egg-info/top_level.txt
writing manifest file '/tmp/pip-req-build-ogbew814/pip-egg-info/apex.egg-info/SOURCES.txt'
reading manifest file '/tmp/pip-req-build-ogbew814/pip-egg-info/apex.egg-info/SOURCES.txt'
writing manifest file '/tmp/pip-req-build-ogbew814/pip-egg-info/apex.egg-info/SOURCES.txt'
/tmp/pip-req-build-ogbew814/setup.py:43: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
  warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")

Source in /tmp/pip-req-build-ogbew814 has version 0.1, which satisfies requirement apex==0.1 from file:///home/yeliu/apex
Removed apex==0.1 from file:///home/yeliu/apex from build tracker '/tmp/pip-req-tracker-vy9ko0xu'
Skipping wheel build for apex, due to binaries being disabled for it.
Installing collected packages: apex
Found existing installation: apex 0.1
Uninstalling apex-0.1:
Created temporary directory: /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/~pex-0.1.dist-info
Removing file or directory /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/apex-0.1.dist-info/
Created temporary directory: /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/~pex
Removing file or directory /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/apex/
Successfully uninstalled apex-0.1
Created temporary directory: /tmp/pip-record-y68xyz25
Running command /home/yeliu/anaconda3/envs/allen/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-ogbew814/setup.py'"'"'; file='"'"'/tmp/pip-req-build-ogbew814/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-y68xyz25/install-record.txt --single-version-externally-managed --compile

Warning: Torch did not find available GPUs on this system.
 If your intention is to cross-compile, this is not an error.
By default, Apex will cross-compile for Pascal (compute capabilities 6.0, 6.1, 6.2),
Volta (compute capability 7.0), and Turing (compute capability 7.5).
If you wish to cross-compile for a single specific architecture,
export TORCH_CUDA_ARCH_LIST="compute capability" before running setup.py.

torch.__version__  =  1.3.1
/tmp/pip-req-build-ogbew814/setup.py:43: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
  warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")
No CUDA runtime is found, using CUDA_HOME='/usr'
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "/tmp/pip-req-build-ogbew814/setup.py", line 100, in <module>
    check_cuda_torch_binary_vs_bare_metal(torch.utils.cpp_extension.CUDA_HOME)
  File "/tmp/pip-req-build-ogbew814/setup.py", line 66, in check_cuda_torch_binary_vs_bare_metal
    torch_binary_major = torch.version.cuda.split(".")[0]
AttributeError: 'NoneType' object has no attribute 'split'
Running setup.py install for apex ... error

Rolling back uninstall of apex
Moving to /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/apex-0.1.dist-info/
from /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/~pex-0.1.dist-info
Moving to /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/apex/
from /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/~pex
Replacing /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/apex-0.1.dist-info/ from /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/~pex-0.1.dist-info
Replacing /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/apex/ from /home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/~pex
Cleaning up...
Removing source in /tmp/pip-req-build-ogbew814
Removed build tracker '/tmp/pip-req-tracker-vy9ko0xu'
ERROR: Command errored out with exit status 1: /home/yeliu/anaconda3/envs/allen/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-ogbew814/setup.py'"'"'; file='"'"'/tmp/pip-req-build-ogbew814/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-y68xyz25/install-record.txt --single-version-externally-managed --compile Check the logs for full command output.
Exception information:
Traceback (most recent call last):
File "/home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/pip/_internal/cli/base_command.py", line 153, in _main
status = self.run(options, args)
File "/home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/pip/_internal/commands/install.py", line 455, in run
use_user_site=options.use_user_site,
File "/home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/pip/_internal/req/init.py", line 62, in install_given_reqs
**kwargs
File "/home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/pip/_internal/req/req_install.py", line 888, in install
cwd=self.unpacked_source_directory,
File "/home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/pip/_internal/utils/subprocess.py", line 275, in runner
spinner=spinner,
File "/home/yeliu/anaconda3/envs/allen/lib/python3.7/site-packages/pip/_internal/utils/subprocess.py", line 242, in call_subprocess
raise InstallationError(exc_msg)
pip._internal.exceptions.InstallationError: Command errored out with exit status 1: /home/yeliu/anaconda3/envs/allen/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-ogbew814/setup.py'"'"'; file='"'"'/tmp/pip-req-build-ogbew814/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(file);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, file, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-y68xyz25/install-record.txt --single-version-externally-managed --compile Check the logs for full command output.
1 location(s) to search for versions of pip:

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with setup.py and reproduce the reported pip install command using the environment details in the log, especially torch 1.3.1 and the --cpp_ext and --cuda_ext options. Trace the failure around check_cuda_torch_binary_vs_bare_metal and define done as a clear installation result or a documented, actionable error for this configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
build-system
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.