google / google/jaxopt

diag(JTJ) can be more efficient

Open
#580 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
1.1k
Forks
76
Avg merge
2d 21h
Merged PRs (30d)
1

Description

In LM method, the `max(diag(JTJ))` is used to set the damping factor. As per option 2 in https://github.com/google/jax/issues/19711 it can be made more efficient than currrently implemented. I discovered this when I hit some OOM problems with jaxopt's LM.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.