apache / apache/iotdb

精度问题怎么解决 how to solve precision

Open
#16,014 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.4k
Forks
1.2k
Avg merge
1d 23h
Merged PRs (30d)
115

Description

比如两个float或者double类型的字段相加或者用聚合函数(sum),得到的结果因为浮点数的限制会出现类似于xxx.xxx000000002这样的结果,大家有什么解决办法吗
For instance, when two fields of float or double type are added or an aggregate function (like sum) is used, the result obtained may result in something like xxx.xxx000000002 due to the limitation of floating-point numbers. Do you have any solutions

Contributor guide

Open the contributing guide

Research direction

The issue mentions float or double fields, arithmetic, and aggregate SUM results but names no files, tests, or entry points. First determine how IoTDB represents and computes floating-point values in these operations; done would require an agreed solution to the reported precision behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.