vectordotdev / vectordotdev/vector-test-harness
Add the ability to reference and compare individual test harness invocations (including for the same commit)
Open
Nobody has claimed this yet.
- Dominant language
- HCL
- Stars
- 33
- Forks
- 10
- PR merge metrics
- No merged PRs in 30d
Description
In some cases, we want to compare test harness runs for the same commit of the same PR, to validate the test results and gain confidence in the test harness correctness.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing how the test harness identifies and records invocations, then determine how separate runs for the same commit and pull request could be referenced and compared. Done should include a defined way to distinguish individual invocations and compare their test results, but the issue does not name files or tests to run.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- terraform
- Domain
- testing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100