huggingface / huggingface/candle

`sort_last_dim` fails on cuda

Open
#2,181 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

```
[mlx_core/src/sampler.rs:48:9] &probs = Tensor[dims 32000; f32, cuda:0]

thread '' panicked at /src/lib.rs:133:25:
run_engine error: DriverError(CUDA_ERROR_INVALID_VALUE, "invalid argument")
0: as candle_core::cuda_backend::error::WrapErr>::w
1: ::cuda_fwd
2: candle_core::storage::Storage::apply_op1
---

| NVIDIA-SMI 545.23.08 Driver Version: 545.23.08 CUDA Version: 12.3 |
| 0 NVIDIA GeForce RTX 2070 On | 00000000:09:00.0 On | N/A |

```

Adding a ` .to_device(&Device::Cpu)?` before it fixes it and produces correct results.

I'm using the latest commit `13c64f6828360a9cb9b58b4f817e4f3b8316388c`

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.