lincc-frameworks / lincc-frameworks/hyrax
Implement basic performance benchmark
@Graciaaa3 is already working on this.
Since Jun 29, 2026.
- Dominant language
- Python
- Stars
- 41
- Forks
- 7
- Avg merge
- 5d 1h
- Merged PRs (30d)
- 8
Description
We received a report that the time needed to run training with Hyrax was ~2-3x longer compared to training with pure PyTorch.
It would be good to benchmark our performance. The most obvious case to me is training the HyraxCNN using the HyraxCifar dataset.
PyTorch documentation provides a very straightforward implementation (in fact that is what HyraxCNN and HyraxCifar as based on) here: https://docs.pytorch.org/tutorials/beginner/blitz/cifar10_tutorial.html
A highlevel understanding of the difference in training time for Hyrax vs. PyTorch would be very helpful. Ultimately we would want to be able to get very fine grained so that we can improve Hyrax performance as needed, but anything is better than nothing. As a first pass we would want to know whether there is a significant disparity (on the order of 2-3x slower) or not.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.