google / google/aqt

generalized einsum or matmul api for pure jax

Open
#600 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
361
Forks
33
Avg merge
18h 9m
Merged PRs (30d)
4

Description

I want to use this package in the following ways.

```
x = jax.random.normal(jax.random.PRNGKey(0), (4, 4), dtype=jnp.bfloat16)
w = jax.random.normal(jax.random.PRNGKey(1), (4, 3), dtype=jnp.bfloat16)
w_q = quantize(w) # it might return QTensor in this package.
y = einsum('ij,jk->ik', x, w_q, lhs=jnp.bfloat16, rhs=QTensor) # it might return jnp.bfloat16 for type promotion rule.
```

Do I have to do this now? I tried, but couldn't reach the solution. I want to get the solution with the fused kernel so that the overhead is minimized.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.