huggingface / huggingface/candle

Save state during forward in CustomOp

Open
#3,305 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

Is there a way to save values during the forward pass in `CustomOp` and use them in the backward pass?

For most non trivial operations you would implement there will be state to be saved in order to have an efficient backward pass.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the CustomOp implementation and its forward and backward entry points. Determine how forward-pass state could be retained for backward use, then establish the expected API and tests that demonstrate saved values are available during backward.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.