huggingface / huggingface/candle
Surprising lack of gradient clipping
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
I'm noticing a _surprising_ lack of gradient clipping, as it is usually a core feature.
What's the reason for its lack of existence, and how could I add it myself?
Given the wealth of functions on tensors it wouldn't be that hard to add, I'm just not sure where it would go.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reading Candle's tensor APIs and tracing where training or optimization operations would accept gradient-related behavior. Clarify the expected clipping semantics and integration point with maintainers before changing code; done should include an agreed implementation and coverage for the chosen behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100