biocompute-objects / biocompute-objects/BCO_Documentation

ECO - Evidence and Conclusion Ontology

Open
#33 0 comments 0 reactions 2 assignees Claimed by @HadleyKing View on GitHub
discuss Future version help wanted
Dominant language
HTML
Stars
17
Forks
13
PR merge metrics
No merged PRs in 30d

Description

The [error_domain ](https://github.com/biocompute-objects/BCO_Specification/blob/master/error-domain.md) should use [ECO](http://www.evidenceontology.org/about_us/) to describe the results.
This would mean updating the text as well as creating a good example. @rajamazumder and @openbox-bio are currently working on an example that may be a good test case.

Other suggestions/comments welcome.
Currently this is only described as follows:

>The empirical error subdomain contains the limits of detectability, false positives, false negatives, statistical confidence of outcomes, etc. This can be measured by running the algorithm on multiple data samples of the usability domain or in carefully designed in-silico spiked data. For example, a set of spiked, well-characterized samples can be run through the algorithm to determine the false positives, negatives and limits of detection.
>The algorithmic subdomain is descriptive of errors that originated by fuzziness of the algorithms, driven by stochastic processes, in dynamically parallelized multi-threaded executions, or in machine learning methodologies where the state of the machine can affect the outcome. This can be measured in repeatability experiments of multiple runs or using some rigorous mathematical modeling of the accumulated errors. For example: bootstrapping is frequently used with stochastic simulation based algorithms to accumulate sets of outcomes and estimate statistically significant variability for the results.

Maybe we could incorporate this elsewhere too?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.