BurntSushi / BurntSushi/critcmp

output group order is different from cli

Open
#19 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
271
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Currently, it seems that the output results from critcmp are sorted by time, with faster groups appearing first. However, this might not be consistent with the order specified in the CLI, which could be confusing. Perhaps there could be an option to follow the order from the CLI or place the fastest group first.

```
critcmp ~/Downloads/benchcmp2.json ~/Downloads/master.json
group benchcmp2_cecf96b9 master
----- ------------------ ------
bufvec/manual_chunk 1.01 4.3±0.02µs ? ?/sec 1.00 4.3±0.02µs ? ?/sec

critcmp ~/Downloads/benchcmp2.json ~/Downloads/0.0.1.json
group 0.0.1 benchcmp2_cecf96b9
----- ----- ------------------
bufvec/manual_chunk 1.00 4.3±0.03µs ? ?/sec 1.00 4.3±0.02µs ? ?/sec
```
[data.json.zip](https://github.com/BurntSushi/critcmp/files/14082006/data.json.zip)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the two critcmp commands in the issue with the attached data.json.zip, then trace the CLI output-ordering entry point. Determine how groups are currently sorted and clarify whether the intended behavior is CLI order, fastest-first, or a selectable option. Done means the chosen ordering is implemented and covered by a regression test.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
cli
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.