canonical / canonical/pytest-interface-tester

Improve test failure message

Open
#6 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1
Forks
5
Avg merge
3d 1h
Merged PRs (30d)
1

Description

A test failure looks like this:

```
ERROR interface_tester.interface_test:runner.py:55 Failed check 3: validating schema on scene output: 2 validation errors for ProviderSchema
app -> url
field required (type=value_error.missing)
app -> ingesters -> 0 -> protocol
field required (type=value_error.missing)
```

It could be handy if there also was:
- A link to the schema / doc / test.
- More detailed context. It is not clear from "validation errors for ProviderSchema" what was being tested. Does it mean: "a stand-in requirer was not able to parse what the lib's TracingProvider rendered"?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at runner.py:55, where the shown failure is reported, and trace how ProviderSchema validation errors are formatted. Reproduce the scene-output failure and determine what schema, documentation, or test links and contextual explanation are available; done means the message provides the requested context and useful link without losing the validation details.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
testing
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.