huggingface / huggingface/candle

Pub fn to get cublas handler?

Open
#1,649 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

it seems no way to get the Arc from CudaDevice; Create another one would waste device resource.

https://github.com/huggingface/candle/blob/9e824ec810fbe490f21b7404058b6cb47d24c6cf/candle-core/src/cuda_backend.rs#L85

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked location in candle-core/src/cuda_backend.rs around line 85 and inspect how CudaDevice owns or accesses CudaBlas. Done means exposing the existing Arc without creating another handler or wasting device resources.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
machine-learning
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.