InternLM / InternLM/lmdeploy

[Docs] Add docs to NVTX options

Open
#1,595 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
8.1k
Forks
748
Avg merge
6d 2h
Merged PRs (30d)
54

Description

### 📚 The doc issue

when building lmdeploy from `build_all_wheel.sh`, by default the NVTX option is `ON` at compile time. However, you also need to set environment variable `FT_NVTX` to `ON` so that the `is_enable_ft_nvtx` can be set to `true` and then `nvtx push` and `nvtx pop` are actually triggered.
image
image

### Suggest a potential alternative/fix

Maybe just add some comments in `entrypoint_build.sh` or `CMakeLists.txt` to let users know : )

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.