canonical / canonical/pytest-interface-tester
Improve test failure message
- Dominant language
- Python
- Stars
- 1
- Forks
- 5
- Avg merge
- 3d 1h
- Merged PRs (30d)
- 1
Description
A test failure looks like this:
```
ERROR interface_tester.interface_test:runner.py:55 Failed check 3: validating schema on scene output: 2 validation errors for ProviderSchema
app -> url
field required (type=value_error.missing)
app -> ingesters -> 0 -> protocol
field required (type=value_error.missing)
```
It could be handy if there also was:
- A link to the schema / doc / test.
- More detailed context. It is not clear from "validation errors for ProviderSchema" what was being tested. Does it mean: "a stand-in requirer was not able to parse what the lib's TracingProvider rendered"?
Contributor guide
No contributing guide indexed for this repository
Research direction
Start at runner.py:55, where the shown failure is reported, and trace how ProviderSchema validation errors are formatted. Reproduce the scene-output failure and determine what schema, documentation, or test links and contextual explanation are available; done means the message provides the requested context and useful link without losing the validation details.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100