InseeFr / InseeFr/Trevas

Calculation accuracies

Open
#332 2 comments 0 reactions 0 assignees View on GitHub
TCK issue
Dominant language
Java
Stars
20
Forks
7
Avg merge
1d 5h
Merged PRs (30d)
12

Description

@noahboerger reported:

- In trevas the result of an operation is kept in double accuracy (e.g. numeric/power_1)
- User tests assume sometimes less accurate results (e.g. user test: 8.006001 trevas: 8.006000999999998)

I think every language will give this kind of result. To be sure of the result, if a particular precision is needed, user can use `round` operator. @hadrienk, can you confirm?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.