NVIDIA / NVIDIA/apex

Cant build on pytorch 1.5 and cuda 10.2

Open
#876 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
9k
Forks
1.5k
Avg merge
2d 4h
Merged PRs (30d)
3

Description

nvcc --version output

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2019 NVIDIA Corporation
Built on Wed_Oct_23_19:24:38_PDT_2019
Cuda compilation tools, release 10.2, V10.2.89

trace

Processing /home/ubuntu/apex
Skipping wheel build for apex, due to binaries being disabled for it.
Installing collected packages: apex
    Running setup.py install for apex ... error
    ERROR: Command errored out with exit status 1:
     command: /home/ubuntu/anaconda3/envs/pytorch_p36/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-req-build-e8_oo9__/setup.py'"'"'; __file__='"'"'/tmp/pip-req-build-e8_oo9__/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' --cpp_ext --cuda_ext install --record /tmp/pip-record-mp_vnbjm/install-record.txt --single-version-externally-managed --compile --install-headers /home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m/apex
         cwd: /tmp/pip-req-build-e8_oo9__/
    Complete output (1661 lines):
    
    
    torch.__version__  = 1.5.0
    
    
    /tmp/pip-req-build-e8_oo9__/setup.py:51: UserWarning: Option --pyprof not specified. Not installing PyProf dependencies!
      warnings.warn("Option --pyprof not specified. Not installing PyProf dependencies!")
    
    Compiling cuda extensions with
    nvcc: NVIDIA (R) Cuda compiler driver
    Copyright (c) 2005-2019 NVIDIA Corporation
    Built on Wed_Oct_23_19:24:38_PDT_2019
    Cuda compilation tools, release 10.2, V10.2.89
    from /usr/local/cuda/bin
    
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.6
    creating build/lib.linux-x86_64-3.6/apex
    copying apex/__init__.py -> build/lib.linux-x86_64-3.6/apex
    creating build/lib.linux-x86_64-3.6/apex/reparameterization
    copying apex/reparameterization/reparameterization.py -> build/lib.linux-x86_64-3.6/apex/reparameterization
    copying apex/reparameterization/weight_norm.py -> build/lib.linux-x86_64-3.6/apex/reparameterization
    copying apex/reparameterization/__init__.py -> build/lib.linux-x86_64-3.6/apex/reparameterization
    creating build/lib.linux-x86_64-3.6/apex/optimizers
    copying apex/optimizers/fused_lamb.py -> build/lib.linux-x86_64-3.6/apex/optimizers
    copying apex/optimizers/fused_adagrad.py -> build/lib.linux-x86_64-3.6/apex/optimizers
    copying apex/optimizers/fused_novograd.py -> build/lib.linux-x86_64-3.6/apex/optimizers
    copying apex/optimizers/fused_adam.py -> build/lib.linux-x86_64-3.6/apex/optimizers
    copying apex/optimizers/fused_sgd.py -> build/lib.linux-x86_64-3.6/apex/optimizers
    copying apex/optimizers/__init__.py -> build/lib.linux-x86_64-3.6/apex/optimizers
    creating build/lib.linux-x86_64-3.6/apex/normalization
    copying apex/normalization/fused_layer_norm.py -> build/lib.linux-x86_64-3.6/apex/normalization
    copying apex/normalization/__init__.py -> build/lib.linux-x86_64-3.6/apex/normalization
    creating build/lib.linux-x86_64-3.6/apex/RNN
    copying apex/RNN/cells.py -> build/lib.linux-x86_64-3.6/apex/RNN
    copying apex/RNN/models.py -> build/lib.linux-x86_64-3.6/apex/RNN
    copying apex/RNN/RNNBackend.py -> build/lib.linux-x86_64-3.6/apex/RNN
    copying apex/RNN/__init__.py -> build/lib.linux-x86_64-3.6/apex/RNN
    creating build/lib.linux-x86_64-3.6/apex/parallel
    copying apex/parallel/LARC.py -> build/lib.linux-x86_64-3.6/apex/parallel
    copying apex/parallel/distributed.py -> build/lib.linux-x86_64-3.6/apex/parallel
    copying apex/parallel/sync_batchnorm.py -> build/lib.linux-x86_64-3.6/apex/parallel
    copying apex/parallel/optimized_sync_batchnorm_kernel.py -> build/lib.linux-x86_64-3.6/apex/parallel
    copying apex/parallel/sync_batchnorm_kernel.py -> build/lib.linux-x86_64-3.6/apex/parallel
    copying apex/parallel/multiproc.py -> build/lib.linux-x86_64-3.6/apex/parallel
    copying apex/parallel/optimized_sync_batchnorm.py -> build/lib.linux-x86_64-3.6/apex/parallel
    copying apex/parallel/__init__.py -> build/lib.linux-x86_64-3.6/apex/parallel
    creating build/lib.linux-x86_64-3.6/apex/contrib
    copying apex/contrib/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib
    creating build/lib.linux-x86_64-3.6/apex/multi_tensor_apply
    copying apex/multi_tensor_apply/multi_tensor_apply.py -> build/lib.linux-x86_64-3.6/apex/multi_tensor_apply
    copying apex/multi_tensor_apply/__init__.py -> build/lib.linux-x86_64-3.6/apex/multi_tensor_apply
    creating build/lib.linux-x86_64-3.6/apex/pyprof
    copying apex/pyprof/__init__.py -> build/lib.linux-x86_64-3.6/apex/pyprof
    creating build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/frontend.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/__version__.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/handle.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/scaler.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/utils.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/amp.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/_initialize.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/_amp_state.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/rnn_compat.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/_process_optimizer.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/wrap.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/opt.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/compat.py -> build/lib.linux-x86_64-3.6/apex/amp
    copying apex/amp/__init__.py -> build/lib.linux-x86_64-3.6/apex/amp
    creating build/lib.linux-x86_64-3.6/apex/fp16_utils
    copying apex/fp16_utils/fp16util.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
    copying apex/fp16_utils/loss_scaler.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
    copying apex/fp16_utils/fp16_optimizer.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
    copying apex/fp16_utils/__init__.py -> build/lib.linux-x86_64-3.6/apex/fp16_utils
    creating build/lib.linux-x86_64-3.6/apex/mlp
    copying apex/mlp/mlp.py -> build/lib.linux-x86_64-3.6/apex/mlp
    copying apex/mlp/__init__.py -> build/lib.linux-x86_64-3.6/apex/mlp
    creating build/lib.linux-x86_64-3.6/apex/contrib/xentropy
    copying apex/contrib/xentropy/softmax_xentropy.py -> build/lib.linux-x86_64-3.6/apex/contrib/xentropy
    copying apex/contrib/xentropy/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib/xentropy
    creating build/lib.linux-x86_64-3.6/apex/contrib/optimizers
    copying apex/contrib/optimizers/fused_lamb.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
    copying apex/contrib/optimizers/distributed_fused_lamb.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
    copying apex/contrib/optimizers/fused_adam.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
    copying apex/contrib/optimizers/distributed_fused_adam_v3.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
    copying apex/contrib/optimizers/fp16_optimizer.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
    copying apex/contrib/optimizers/fused_sgd.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
    copying apex/contrib/optimizers/distributed_fused_adam_v2.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
    copying apex/contrib/optimizers/distributed_fused_adam.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
    copying apex/contrib/optimizers/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib/optimizers
    creating build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    copying apex/contrib/multihead_attn/mask_softmax_dropout_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    copying apex/contrib/multihead_attn/self_multihead_attn.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    copying apex/contrib/multihead_attn/self_multihead_attn_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    copying apex/contrib/multihead_attn/encdec_multihead_attn_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    copying apex/contrib/multihead_attn/fast_self_multihead_attn_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    copying apex/contrib/multihead_attn/fast_self_multihead_attn_norm_add_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    copying apex/contrib/multihead_attn/fast_encdec_multihead_attn_norm_add_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    copying apex/contrib/multihead_attn/fast_encdec_multihead_attn_func.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    copying apex/contrib/multihead_attn/encdec_multihead_attn.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    copying apex/contrib/multihead_attn/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib/multihead_attn
    creating build/lib.linux-x86_64-3.6/apex/contrib/groupbn
    copying apex/contrib/groupbn/batch_norm.py -> build/lib.linux-x86_64-3.6/apex/contrib/groupbn
    copying apex/contrib/groupbn/__init__.py -> build/lib.linux-x86_64-3.6/apex/contrib/groupbn
    creating build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/__main__.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/prof.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/linear.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/conv.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/loss.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/normalization.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/optim.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/usage.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/randomSample.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/convert.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/blas.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/recurrentCell.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/base.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/misc.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/output.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/embedding.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/pointwise.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/data.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/softmax.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/activation.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/dropout.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/utility.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/index_slice_join_mutate.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/__init__.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/pooling.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    copying apex/pyprof/prof/reduction.py -> build/lib.linux-x86_64-3.6/apex/pyprof/prof
    creating build/lib.linux-x86_64-3.6/apex/pyprof/nvtx
    copying apex/pyprof/nvtx/nvmarker.py -> build/lib.linux-x86_64-3.6/apex/pyprof/nvtx
    copying apex/pyprof/nvtx/__init__.py -> build/lib.linux-x86_64-3.6/apex/pyprof/nvtx
    creating build/lib.linux-x86_64-3.6/apex/pyprof/parse
    copying apex/pyprof/parse/__main__.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
    copying apex/pyprof/parse/db.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
    copying apex/pyprof/parse/nvvp.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
    copying apex/pyprof/parse/kernel.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
    copying apex/pyprof/parse/parse.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
    copying apex/pyprof/parse/__init__.py -> build/lib.linux-x86_64-3.6/apex/pyprof/parse
    creating build/lib.linux-x86_64-3.6/apex/amp/lists
    copying apex/amp/lists/torch_overrides.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
    copying apex/amp/lists/tensor_overrides.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
    copying apex/amp/lists/functional_overrides.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
    copying apex/amp/lists/__init__.py -> build/lib.linux-x86_64-3.6/apex/amp/lists
    running build_ext
    building 'apex_C' extension
    creating /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6
    creating /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc
    Emitting ninja build file /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/build.ninja...
    Compiling objects...
    Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
    [1/1] c++ -MMD -MF /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/flatten_unflatten.o.d -pthread -B /home/ubuntu/anaconda3/envs/pytorch_p36/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/flatten_unflatten.cpp -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/flatten_unflatten.o -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=apex_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
    cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
    In file included from /tmp/pip-req-build-e8_oo9__/csrc/flatten_unflatten.cpp:2:0:
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/utils/tensor_flatten.h: In member function ‘at::DeprecatedTypeProperties& torch::utils::TensorGroup::type()’:
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/utils/tensor_flatten.h:36:28: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
         return tensors[0].type();
                                ^
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Tensor.h:11:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Context.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:5,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/flatten_unflatten.cpp:1:
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/core/TensorBody.h:262:30: note: declared here
       DeprecatedTypeProperties & type() const {
                                  ^
    g++ -pthread -shared -B /home/ubuntu/anaconda3/envs/pytorch_p36/compiler_compat -L/home/ubuntu/anaconda3/envs/pytorch_p36/lib -Wl,-rpath=/home/ubuntu/anaconda3/envs/pytorch_p36/lib -Wl,--no-as-needed -Wl,--sysroot=/ /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/flatten_unflatten.o -L/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/lib -lc10 -ltorch -ltorch_cpu -ltorch_python -o build/lib.linux-x86_64-3.6/apex_C.cpython-36m-x86_64-linux-gnu.so
    building 'amp_C' extension
    Emitting ninja build file /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/build.ninja...
    Compiling objects...
    Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
    [1/11] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/multi_tensor_lamb_stage_2.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb_stage_2.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [2/11] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/multi_tensor_adagrad.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_adagrad.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [3/11] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/multi_tensor_scale_kernel.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_scale_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [4/11] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/multi_tensor_novograd.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_novograd.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [5/11] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/multi_tensor_sgd_kernel.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_sgd_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [6/11] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/multi_tensor_adam.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_adam.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [7/11] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/multi_tensor_lamb_stage_1.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb_stage_1.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [8/11] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/multi_tensor_axpby_kernel.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_axpby_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [9/11] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/multi_tensor_l2norm_kernel.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_l2norm_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [10/11] c++ -MMD -MF /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/amp_C_frontend.o.d -pthread -B /home/ubuntu/anaconda3/envs/pytorch_p36/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/amp_C_frontend.cpp -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/amp_C_frontend.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
    cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
    [11/11] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/multi_tensor_lamb.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -lineinfo -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=amp_C -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    g++ -pthread -shared -B /home/ubuntu/anaconda3/envs/pytorch_p36/compiler_compat -L/home/ubuntu/anaconda3/envs/pytorch_p36/lib -Wl,-rpath=/home/ubuntu/anaconda3/envs/pytorch_p36/lib -Wl,--no-as-needed -Wl,--sysroot=/ /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/amp_C_frontend.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_sgd_kernel.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_scale_kernel.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_axpby_kernel.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_l2norm_kernel.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb_stage_1.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb_stage_2.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_adam.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_adagrad.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_novograd.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/multi_tensor_lamb.o -L/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/lib -L/usr/local/cuda/lib64 -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-3.6/amp_C.cpython-36m-x86_64-linux-gnu.so
    building 'syncbn' extension
    Emitting ninja build file /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/build.ninja...
    Compiling objects...
    Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
    [1/2] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/welford.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/welford.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=syncbn -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [2/2] c++ -MMD -MF /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/syncbn.o.d -pthread -B /home/ubuntu/anaconda3/envs/pytorch_p36/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/syncbn.cpp -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/syncbn.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=syncbn -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
    cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
    g++ -pthread -shared -B /home/ubuntu/anaconda3/envs/pytorch_p36/compiler_compat -L/home/ubuntu/anaconda3/envs/pytorch_p36/lib -Wl,-rpath=/home/ubuntu/anaconda3/envs/pytorch_p36/lib -Wl,--no-as-needed -Wl,--sysroot=/ /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/syncbn.o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/welford.o -L/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/lib -L/usr/local/cuda/lib64 -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-3.6/syncbn.cpython-36m-x86_64-linux-gnu.so
    building 'fused_layer_norm_cuda' extension
    Emitting ninja build file /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/build.ninja...
    Compiling objects...
    Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
    [1/2] /usr/local/cuda/bin/nvcc -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda_kernel.cu -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/layer_norm_cuda_kernel.o -D__CUDA_NO_HALF_OPERATORS__ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options '-fPIC' -maxrregcount=50 -O3 --use_fast_math -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=fused_layer_norm_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_70,code=sm_70 -std=c++14
    [2/2] c++ -MMD -MF /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/layer_norm_cuda.o.d -pthread -B /home/ubuntu/anaconda3/envs/pytorch_p36/compiler_compat -Wl,--sysroot=/ -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -Wstrict-prototypes -fPIC -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/TH -I/home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/THC -I/usr/local/cuda/include -I/home/ubuntu/anaconda3/envs/pytorch_p36/include/python3.6m -c -c /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp -o /tmp/pip-req-build-e8_oo9__/build/temp.linux-x86_64-3.6/csrc/layer_norm_cuda.o -O3 -DVERSION_GE_1_1 -DVERSION_GE_1_3 -DVERSION_GE_1_5 -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=fused_layer_norm_cuda -D_GLIBCXX_USE_CXX11_ABI=0 -std=c++14
    cc1plus: warning: command line option ‘-Wstrict-prototypes’ is valid for C/ObjC but not for C++
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/DeviceType.h:8:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/Device.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/Allocator.h:6,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:1:
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp: In function ‘std::vector<at::Tensor> layer_norm(at::Tensor, c10::IntArrayRef, double)’:
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
                                              ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/macros/Macros.h:141:65: note: in definition of macro ‘C10_UNLIKELY’
     #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
                                                                     ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:262:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
       if (C10_UNLIKELY_OR_CONST(!(cond))) {                     \
           ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:273:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
     #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
                                    ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
     #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
                           ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
     #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
                            ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:129:3: note: in expansion of macro ‘CHECK_INPUT’
       CHECK_INPUT(input);
       ^
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Tensor.h:11:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Context.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:5,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:1:
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/core/TensorBody.h:262:30: note: declared here
       DeprecatedTypeProperties & type() const {
                                  ^
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/DeviceType.h:8:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/Device.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/Allocator.h:6,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:1:
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp: In function ‘std::vector<at::Tensor> layer_norm_affine(at::Tensor, c10::IntArrayRef, at::Tensor, at::Tensor, double)’:
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
                                              ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/macros/Macros.h:141:65: note: in definition of macro ‘C10_UNLIKELY’
     #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
                                                                     ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:262:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
       if (C10_UNLIKELY_OR_CONST(!(cond))) {                     \
           ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:273:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
     #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
                                    ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
     #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
                           ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
     #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
                            ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:149:3: note: in expansion of macro ‘CHECK_INPUT’
       CHECK_INPUT(input);
       ^
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Tensor.h:11:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Context.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:5,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:1:
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/core/TensorBody.h:262:30: note: declared here
       DeprecatedTypeProperties & type() const {
                                  ^
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/DeviceType.h:8:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/Device.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/Allocator.h:6,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:1:
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
                                              ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/macros/Macros.h:141:65: note: in definition of macro ‘C10_UNLIKELY’
     #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
                                                                     ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:262:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
       if (C10_UNLIKELY_OR_CONST(!(cond))) {                     \
           ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:273:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
     #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
                                    ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
     #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
                           ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
     #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
                            ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:150:3: note: in expansion of macro ‘CHECK_INPUT’
       CHECK_INPUT(gamma);
       ^
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Tensor.h:11:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Context.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:5,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:1:
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/core/TensorBody.h:262:30: note: declared here
       DeprecatedTypeProperties & type() const {
                                  ^
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/DeviceType.h:8:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/Device.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/Allocator.h:6,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:1:
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
                                              ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/macros/Macros.h:141:65: note: in definition of macro ‘C10_UNLIKELY’
     #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
                                                                     ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:262:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
       if (C10_UNLIKELY_OR_CONST(!(cond))) {                     \
           ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:273:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
     #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
                                    ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
     #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
                           ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
     #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
                            ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:151:3: note: in expansion of macro ‘CHECK_INPUT’
       CHECK_INPUT(beta);
       ^
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Tensor.h:11:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Context.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:5,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:1:
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/core/TensorBody.h:262:30: note: declared here
       DeprecatedTypeProperties & type() const {
                                  ^
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/DeviceType.h:8:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/Device.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/core/Allocator.h:6,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:1:
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp: In function ‘at::Tensor layer_norm_gradient(at::Tensor, at::Tensor, at::Tensor, at::Tensor, c10::IntArrayRef, double)’:
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:117:42: warning: ‘at::DeprecatedTypeProperties& at::Tensor::type() const’ is deprecated: Tensor.type() is deprecated. Instead use Tensor.options(), which in many cases (e.g. in a constructor) is a drop-in replacement. If you were using data from type(), that is now available from Tensor itself, so instead of tensor.type().scalar_type(), use tensor.scalar_type() instead and instead of tensor.type().backend() use tensor.device(). [-Wdeprecated-declarations]
     #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
                                              ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/macros/Macros.h:141:65: note: in definition of macro ‘C10_UNLIKELY’
     #define C10_UNLIKELY(expr)  (__builtin_expect(static_cast<bool>(expr), 0))
                                                                     ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:262:7: note: in expansion of macro ‘C10_UNLIKELY_OR_CONST’
       if (C10_UNLIKELY_OR_CONST(!(cond))) {                     \
           ^
    /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/c10/util/Exception.h:273:32: note: in expansion of macro ‘TORCH_CHECK_WITH’
     #define TORCH_CHECK(cond, ...) TORCH_CHECK_WITH(Error, cond, __VA_ARGS__)
                                    ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:117:23: note: in expansion of macro ‘TORCH_CHECK’
     #define CHECK_CUDA(x) TORCH_CHECK(x.type().is_cuda(), #x " must be a CUDA tensor")
                           ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:119:24: note: in expansion of macro ‘CHECK_CUDA’
     #define CHECK_INPUT(x) CHECK_CUDA(x); CHECK_CONTIGUOUS(x)
                            ^
    /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:193:3: note: in expansion of macro ‘CHECK_INPUT’
       CHECK_INPUT(dout);
       ^
    In file included from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Tensor.h:11:0,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/Context.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/ATen/ATen.h:5,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/types.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader_options.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/base.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader/stateful.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data/dataloader.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/data.h:3,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/csrc/api/include/torch/all.h:4,
                     from /home/ubuntu/anaconda3/envs/pytorch_p36/lib/python3.6/site-packages/torch/include/torch/extension.h:4,
                     from /tmp/pip-req-build-e8_oo9__/csrc/layer_norm_cuda.cpp:1:
    /home/ubuntu/anaconda3/envs/pyto

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with setup.py and the CUDA extension installation command shown in the report, then reproduce the build with PyTorch 1.5.0 and CUDA 10.2 while capturing the complete compiler error beyond the truncated trace. Done means the Apex package builds and installs successfully with the reported versions.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
build-system, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.