Simplify `log(softmax(x))`
Open
Nobody has claimed this yet.
Perf Improve
- Dominant language
- C++
- Stars
- 333
- Forks
- 150
- Avg merge
- 4d 19h
- Merged PRs (30d)
- 54
Description
- With our changes to softmax we no longer use the log_softmax instruction that does the log and the softmax in one step.
- We need to make a matcher in simplify_algebra or equivalent to simplify a
log(softmax(x))
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the simplify_algebra or equivalent matcher mentioned in the issue and inspect how algebraic expression patterns are represented. Implement recognition for log(softmax(x)) so it simplifies to the combined operation, then verify that the resulting graph no longer leaves the separate log and softmax sequence.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100