Remove tensorflow dependencies

Description mentions that:

```
Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.
```

So it should aim not to need those tensorflow packages