runtimeverification / runtimeverification/haskell-backend

Run `test-prove-functional` as part of `performance-test-kevm.sh`

Open
#4,005 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Haskell
Stars
224
Forks
43
PR merge metrics
No merged PRs in 30d

Description

The KEVM CI is currently failing on a K update in the Proofs: functional job. It is unclear at that point if the backend is the cause of this. In any case, I've noticed we are not running the functional specs from the KEVM test suite when measuring performance, as we only run the test-prove-rules Makefile target. We should run test-prove-functional as well, perhaps in a separate invocation so that the normal tests and the functional ones do not run concurrently.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with performance-test-kevm.sh and compare its existing test-prove-rules invocation with the Makefile's test-prove-functional target. Run the performance test workflow or its relevant command to confirm that the functional specs run separately and that both test groups complete successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
haskell, shell
Domain
ci-cd, performance, testing-qa
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.