microsoft / microsoft/typespec

Update Spector dashboard to express features that are manually tested

Open
#8,896 0 comments 0 reactions 2 assignees Claimed by @iscai-msft View on GitHub
spector triaged:core
Dominant language
Java
Stars
5.9k
Forks
394
Avg merge
1d 23h
Merged PRs (30d)
104

Description

### Clear and concise description of the problem

While our emitter are generating a lot of value out of the box, it has never been a goal to be able to generate every single possible scenarios. But, it is a goal for emitters to be flexible enough to allow customization and manual code to enable any scenarios.

In that spirit, this is possible that some Spector tests cannot be passed by an emitter with only generation and nothing else. For instance, C# union types, Python multipart or Rust API key auth. But we want those tests to pass to demonstrate flexibility.

This issue asks a way for emitter to declare to the Spector report that the test has been passed by writing manual code. Default should be to assume the scenario has been solved with purely generated solution. Once emitter has been passing this information, next step is a UI update to visualize the difference between a test from purely generated code, and a test from generated code with some manual code on top.

### Checklist

- [x] Follow our [Code of Conduct](https://github.com/microsoft/typespec/blob/main/CODE_OF_CONDUCT.md)
- [x] Read the [docs](https://typespec.io/docs/).
- [x] Check that there isn't already an issue that request the same feature to avoid creating a duplicate.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.