llvm / llvm/llvm-lnt

lnt importreport and/or lnt submit seem to disregard the test suite specified

Open
#173 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
35
Forks
34
Avg merge
5h 46m
Merged PRs (30d)
12

Description

Reproducer:

```
# Create an instance and run a server
lnt create my-instance
cat < my-instance/schemas/libcxx.yaml
format_version: '2'
name: libcxx
metrics:
- name: execution_time
type: Real
display_name: Execution Time
unit: seconds
unit_abbrev: s
run_fields:
- name: git_order
order: true
machine_fields:
- name: hardware
- name: os
EOF
lnt runserver my-instance

cat < x.lnt
foo.execution_time 1
bar.execution_time 2
EOF
lnt importreport --testsuite libcxx --order 1 --run-info git_order=99 --machine my-machine x.lnt x.json
lnt submit --testsuite libcxx http://localhost:8000/db_default/submitRun x.json
```

Based on this, I think the problem is in `lnt submit`, which seems to ignore the provided test suite.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by running the provided reproducer with the lnt importreport and lnt submit entry points, then trace how --testsuite is handled by each command. Compare the generated x.json and submitted run to confirm that the libcxx test suite is preserved; done means lnt submit uses the specified suite instead of disregarding it.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.