Conflicting transformers version requirements

First off, thanks for making all of the code open source! I am trying to set the package up (for some evals) but noticed that there is a conflict in transformer version requirements. Concretely, the package

`git+https://github.com/swj0419/transformers` uses version 4.50.0.dev0, while

`ai2-olmes@git+https://github.com/allenai/olmes.git` uses version >=4.51.3

Weijia's fork does include some changes that are not ahead of the transformers library so I am not sure which version is meant to be used here. My guess is that >=4.51.3 should be fine (since it might have incorporated commits for OLMO2 support), but wanted to point it out in case you wanted to update the `.toml` file to rectify this.