ethereum / ethereum/execution-specs

perf(test-benchmark): consider using pypy to fill benchmark releases

Open
#3,402 0 comments 0 reactions 1 assignee Claimed by @danceratopz View on GitHub
A-test-benchmark C-perf
Dominant language
Python
Stars
1.2k
Forks
505
Avg merge
2d 8h
Merged PRs (30d)
106

Description

Just a reminder to try this out. In the just benchmark test recipes, I noticed that `pypy` was notably faster than cpython.

Consensus tests didn't show an improvement with pypy (related issue #2029), but it's worth checking whether that's the case with the benchmark tests.

Perhaps it could be beneficial with benchmarks because we're simply doing much more work that can be re-used by the JIT compilation? So JIT startup is better amortized and savings outweigh the JIT compilation?

It remains to be seen if the increased memory bottleneck prevents us from using pypy.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.