huggingface / huggingface/candle

Surprising lack of gradient clipping

Open
#2,962 1 comment 3 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

I'm noticing a _surprising_ lack of gradient clipping, as it is usually a core feature.
What's the reason for its lack of existence, and how could I add it myself?

Given the wealth of functions on tensors it wouldn't be that hard to add, I'm just not sure where it would go.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading Candle's tensor APIs and tracing where training or optimization operations would accept gradient-related behavior. Clarify the expected clipping semantics and integration point with maintainers before changing code; done should include an agreed implementation and coverage for the chosen behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.