kernelci / kernelci/kernelci-core

Abstract test results and provide higher-level results for users

Open
#2,458 0 comments 0 reactions 1 assignee Claimed by @r-c-n View on GitHub
Dominant language
Python
Stars
120
Forks
107
Avg merge
1d 2h
Merged PRs (30d)
21

Description

After a discussion with @nuclearcat , @JenySadadia and @pawiecz regarding the issues exposed in https://github.com/kernelci/kernelci-core/issues/2455, we identified two diverging opinions on what the KernelCI API should provide as an interface (endpoints, models):

a) a higher-level view of test results and regressions, with expressive query capabilities that clients (users and applications) can use directly. The API should abstract the runtime details about tests such as their intermediate representation by the runtimes, and just store and provide the results in a standard and common way regardless of the test idiosyncrasies.

b) a strictly low-level representation of the test runs, basically an organization of the tests as they are run and of their results as provided by the runtimes. Then, higher-level tools are responsible of processing this low-level data into suitable results for users.

Although I do think that (a) is a more reasonable approach (although a somewhat radical shift from the current design) and it's possibly even compatible with (b), we settled on (b) for now on @nuclearcat 's recommendation.

This issue, then, is a way to encapsulate the efforts to identify and abstract the test result details as provided by the API into something that's more useful for higher-level tools (regression processing, dashboards) and users.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.