awslabs / awslabs/keys_values

Implement test to quantify the impact of different features on gradient approximation

Open
#15 0 comments 0 reactions 0 assignees View on GitHub
enhancement good first issue
Dominant language
Python
Stars
18
Forks
8
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**

There is currently no test to quantify the error in gradients introduced by different approximations, e.g.:

* Quantization of activation checkpoints
* Cell-based computation [any?]
* Autograd saved tensors packing [any?]

**Describe the solution you'd like**

We need a sensible metric (or several) for gradient errors; a setup where gradients can be computed exactly; a way to get to realistic weights.

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are identified. First locate the implementations and tests for activation checkpoint quantization, cell-based computation, and autograd saved-tensor packing, then define a gradient-error metric, an exact-gradient setup, and realistic weights; done means the test quantifies each approximation's impact.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning, testing-qa
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.