build from source error
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 17.9k
- Forks
- 7.3k
- Avg merge
- 1d 15h
- Merged PRs (30d)
- 13
Description
🐛 Describe the bug
background:
I want to use the new function, which need to build torchvison from source.
"""
import torchvision
reader = torchvision.io.VideoReader(file_name, device='cuda:0')
for frame in reader:
print(frame)
"""
information about my computer:
“”“
System: Ubuntu 18.04
Cuda: 10.2 (I also try 11.1)
GPU: RTX3090
”“”
when I run the operation:
python setup.py install
I meet a build problem:
"""
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1865, in _run_ninja_build
subprocess.run(
File "/civi/anaconda3/envs/torch/lib/python3.9/subprocess.py", line 528, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/civi/Torchvision_Decoding_Note/vision/setup.py", line 514, in
setup(
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/init.py", line 87, in setup
return distutils.core.setup(**attrs)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/core.py", line 148, in setup
return run_commands(dist)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/core.py", line 163, in run_commands
dist.run_commands()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 967, in run_commands
self.run_command(cmd)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/dist.py", line 1214, in run_command
super().run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 986, in run_command
cmd_obj.run()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/install.py", line 74, in run
self.do_egg_install()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/install.py", line 123, in do_egg_install
self.run_command('bdist_egg')
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/dist.py", line 1214, in run_command
super().run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 986, in run_command
cmd_obj.run()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/bdist_egg.py", line 165, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/bdist_egg.py", line 151, in call_command
self.run_command(cmdname)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/dist.py", line 1214, in run_command
super().run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 986, in run_command
cmd_obj.run()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/install_lib.py", line 11, in run
self.build()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/command/install_lib.py", line 107, in build
self.run_command('build_ext')
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/dist.py", line 1214, in run_command
super().run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 986, in run_command
cmd_obj.run()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/build_ext.py", line 79, in run
_build_ext.run(self)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/command/build_ext.py", line 339, in run
self.build_extensions()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 778, in build_extensions
build_ext.build_extensions(self)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/command/build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/command/build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/build_ext.py", line 202, in build_extension
_build_ext.build_extension(self, ext)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/command/build_ext.py", line 528, in build_extension
objects = self.compiler.compile(sources,
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 593, in unix_wrap_ninja_compile
_write_ninja_file_and_compile_objects(
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1544, in _write_ninja_file_and_compile_objects
_run_ninja_build(
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1881, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
“”“”
My ninja version:1.11.0
My cuda version:10.2 (I also try 11.1, but failed too)
My installation process:
①conda install pytorch torchvision torchaudio cudatoolkit=10.2 -c pytorch-nightly
②conda install -c conda-forge ffmpeg
③git clone https://github.com/pytorch/vision.git
④cd vision
⑤python setup.py install
Then I met the above build problem
How can I solve this problem?
Versions
The latest ( until 2022 06 13)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with setup.py and the source-build path invoked by python setup.py install. Rerun the build and capture the compiler output before the generic Ninja traceback, then verify the listed Python, CUDA, PyTorch, and ffmpeg versions; done means the source build completes and the VideoReader example can be imported.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- build-system, computer-vision
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100