pytorch / pytorch/vision

build from source error

Open
#6,157 5 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
17.9k
Forks
7.3k
Avg merge
1d 15h
Merged PRs (30d)
13

Description

🐛 Describe the bug

background:
I want to use the new function, which need to build torchvison from source.
"""
import torchvision
reader = torchvision.io.VideoReader(file_name, device='cuda:0')
for frame in reader:
print(frame)
"""

information about my computer:
“”“
System: Ubuntu 18.04
Cuda: 10.2 (I also try 11.1)
GPU: RTX3090
”“”

when I run the operation:
python setup.py install

I meet a build problem:
"""
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1865, in _run_ninja_build
subprocess.run(
File "/civi/anaconda3/envs/torch/lib/python3.9/subprocess.py", line 528, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.

The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/civi/Torchvision_Decoding_Note/vision/setup.py", line 514, in
setup(
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/init.py", line 87, in setup
return distutils.core.setup(**attrs)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/core.py", line 148, in setup
return run_commands(dist)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/core.py", line 163, in run_commands
dist.run_commands()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 967, in run_commands
self.run_command(cmd)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/dist.py", line 1214, in run_command
super().run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 986, in run_command
cmd_obj.run()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/install.py", line 74, in run
self.do_egg_install()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/install.py", line 123, in do_egg_install
self.run_command('bdist_egg')
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/dist.py", line 1214, in run_command
super().run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 986, in run_command
cmd_obj.run()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/bdist_egg.py", line 165, in run
cmd = self.call_command('install_lib', warn_dir=0)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/bdist_egg.py", line 151, in call_command
self.run_command(cmdname)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/dist.py", line 1214, in run_command
super().run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 986, in run_command
cmd_obj.run()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/install_lib.py", line 11, in run
self.build()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/command/install_lib.py", line 107, in build
self.run_command('build_ext')
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/cmd.py", line 313, in run_command
self.distribution.run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/dist.py", line 1214, in run_command
super().run_command(command)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/dist.py", line 986, in run_command
cmd_obj.run()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/build_ext.py", line 79, in run
_build_ext.run(self)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/command/build_ext.py", line 339, in run
self.build_extensions()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 778, in build_extensions
build_ext.build_extensions(self)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/command/build_ext.py", line 448, in build_extensions
self._build_extensions_serial()
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/command/build_ext.py", line 473, in _build_extensions_serial
self.build_extension(ext)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/command/build_ext.py", line 202, in build_extension
_build_ext.build_extension(self, ext)
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/setuptools/_distutils/command/build_ext.py", line 528, in build_extension
objects = self.compiler.compile(sources,
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 593, in unix_wrap_ninja_compile
_write_ninja_file_and_compile_objects(
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1544, in _write_ninja_file_and_compile_objects
_run_ninja_build(
File "/civi/anaconda3/envs/torch/lib/python3.9/site-packages/torch/utils/cpp_extension.py", line 1881, in _run_ninja_build
raise RuntimeError(message) from e
RuntimeError: Error compiling objects for extension
“”“”

My ninja version:1.11.0
My cuda version:10.2 (I also try 11.1, but failed too)

My installation process:
①conda install pytorch torchvision torchaudio cudatoolkit=10.2 -c pytorch-nightly
②conda install -c conda-forge ffmpeg
③git clone https://github.com/pytorch/vision.git
④cd vision
⑤python setup.py install
Then I met the above build problem
How can I solve this problem?

Versions

The latest ( until 2022 06 13)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with setup.py and the source-build path invoked by python setup.py install. Rerun the build and capture the compiler output before the generic Ninja traceback, then verify the listed Python, CUDA, PyTorch, and ffmpeg versions; done means the source build completes and the VideoReader example can be imported.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
build-system, computer-vision
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.