deepjavalibrary / deepjavalibrary/djl

No CUDA events show up in the profiler result

Open
#2,422 3 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
4.9k
Forks
759
Avg merge
16h 15m
Merged PRs (30d)
15

Description

## Description
https://docs.djl.ai/master/docs/development/profiler.html
I follow this page and set useCuda=true but I cannot see any cuda events in the profiler result

![image](https://user-images.githubusercontent.com/105039245/221111213-fc271fdc-a57d-441d-86ef-9cb737a86887.png)

### Expected Behavior
CUDA events

## How to Reproduce?
```
JniUtils.startProfile(true, true, true);
for (int i = 0; i < 10; i++) {
predict(input);
}
JniUtils.stopProfile("/tmp/" + ptModel.getName());
log.info("save profile file to {}", "/tmp/" + ptModel.getName());
```

## Environment Info
DJL version 0.20.0
pytorch-native-cu116
torch version 1.12.1

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.