huggingface / huggingface/candle
Save state during forward in CustomOp
Open
- Dominant language
- Rust
- Stars
- 21k
- Forks
- 1.8k
- Avg merge
- 16h 42m
- Merged PRs (30d)
- 25
Description
Is there a way to save values during the forward pass in `CustomOp` and use them in the backward pass?
For most non trivial operations you would implement there will be state to be saved in order to have an efficient backward pass.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the CustomOp implementation and its forward and backward entry points. Determine how forward-pass state could be retained for backward use, then establish the expected API and tests that demonstrate saved values are available during backward.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100