jwyang / jwyang/faster-rcnn.pytorch

No kernel image is available for execution on the device in "crop" pooling mode

Open
#369 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.9k
Forks
2.3k
PR merge metrics
No merged PRs in 30d

Description

I'm using torch 0.4.0, and cuda 9.0 python 3.6. I've been stopped by this issue for several days.

while running 'python trainval_net.py --net res101 --cuda',

I got the following error:

Loading pretrained weights from data/pretrained_model/resnet101_caffe.pth
**pooling mode: crop
error in BilinearSampler.updateOutput: no kernel image is available for execution on the device**
Traceback (most recent call last):
File "trainval_net.py", line 323, in
rois_label = fasterRCNN(im_data, im_info, gt_boxes, num_boxes)
File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py", line 477, in __call__
result = self.forward(*input, **kwargs)
File "/home/jovyan/pingan/nfs_4/zhenjie/faster-rcnn.pytorch-master/lib/model/faster_rcnn/faster_rcnn.py", line 90, in forward
pooled_feat = self.RCNN_roi_crop(base_feat, Variable(grid_yx).detach())
File "/opt/conda/lib/python3.6/site-packages/torch/nn/modules/module.py", line 477, in __call__
result = self.forward(*input, **kwargs)
File "/home/jovyan/pingan/nfs_4/zhenjie/faster-rcnn.pytorch-master/lib/model/roi_crop/modules/roi_crop.py", line 8, in forward
return RoICropFunction()(input1, input2)
File "/home/jovyan/pingan/nfs_4/zhenjie/faster-rcnn.pytorch-master/lib/model/roi_crop/functions/roi_crop.py", line 14, in forward
roi_crop.BilinearSamplerBHWD_updateOutput_cuda(input1, input2, output)
File "/opt/conda/lib/python3.6/site-packages/torch/utils/ffi/__init__.py", line 202, in safe_call
result = torch._C._safe_call(*args, **kwargs)
**torch.FatalError: aborting at /home/jovyan/pingan/nfs_4/zhenjie/faster-rcnn.pytorch-master/lib/model/roi_crop/src/roi_crop_cuda.c:49**

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the failure with `python trainval_net.py --net res101 --cuda`, then inspect `lib/model/roi_crop/functions/roi_crop.py`, `lib/model/roi_crop/modules/roi_crop.py`, and `lib/model/roi_crop/src/roi_crop_cuda.c`. Trace the `BilinearSampler` call and determine what prevents the crop pooling kernel from executing; done means crop pooling runs without the reported kernel-image error.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
computer-vision
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.