generalized einsum or matmul api for pure jax
Open
- Dominant language
- Python
- Stars
- 361
- Forks
- 33
- Avg merge
- 18h 9m
- Merged PRs (30d)
- 4
Description
I want to use this package in the following ways.
```
x = jax.random.normal(jax.random.PRNGKey(0), (4, 4), dtype=jnp.bfloat16)
w = jax.random.normal(jax.random.PRNGKey(1), (4, 3), dtype=jnp.bfloat16)
w_q = quantize(w) # it might return QTensor in this package.
y = einsum('ij,jk->ik', x, w_q, lhs=jnp.bfloat16, rhs=QTensor) # it might return jnp.bfloat16 for type promotion rule.
```
Do I have to do this now? I tried, but couldn't reach the solution. I want to get the solution with the fused kernel so that the overhead is minimized.
Contributor guide
Assessment
This issue has not been assessed yet.