janestreet / janestreet/core_bench

Catch failures & show as did not complete?

Open
#28 4 comments 0 reactions 0 assignees View on GitHub
forwarded-to-js-devs
Dominant language
OCaml
Stars
57
Forks
15
PR merge metrics
No merged PRs in 30d

Description

I’m trying to benchmark my library against an existing one. It can’t complete the bench since it doesn’t implement the output correctly. If I add `failwith` the whole benchmark suite fails, but I think it should show some a “did not complete message”.

Contributor guide

Open the contributing guide

Research direction

No source file or test is named in the issue. Start by locating the benchmark execution and failure-handling entry points, then reproduce a benchmark that raises failwith; done means an incomplete benchmark is reported as “did not complete” without failing the whole suite.

Written by the indexing model from the issue text.

Assessment

Tech stack
ocaml
Domain
performance
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.