InternLM / InternLM/InternEvo

[Bug] do not use torch.cuda.current_device() as device, since it only retures an int

Open
#130 3 comments 0 reactions 2 assignees Claimed by @sallyjunjun View on GitHub
bug
Dominant language
Python
Stars
421
Forks
67
PR merge metrics
No merged PRs in 30d

Description

### Describe the bug

we have a lot of cases like following:

` data = torch.empty(partition_size, dtype=tensor.dtype, device=torch.cuda.current_device(), requires_grad=False)
`

where we directly use device=torch.cuda.current_device(). However, it is not recommended to do like it, since torch.cuda.current_device() only returns device id. It is OK to run such codes on GPUs. However, maybe there are some problems when running on NPU

### Environment

python3.8 + torch2.1

### Other information

_No response_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.