apache / apache/pinot

Derivated column not reloaded when formula changes

Open
#9,989 7 comments 0 reactions 0 assignees View on GitHub
bug enhancement
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 55m
Merged PRs (30d)
182

Description

Derivated column not reloaded when formula changes

Step to reproduce

1- Add a column to the schema save schema

2- Edit table to add a formula like
```
{
"columnName": "actualexpense.amountExcludingTax",
"transformFunction": "\"actualexpense.amountIncludingTax\"-((\"actualexpense.amountIncludingTax\"/(1+(\"actualexpense.tax\"/100)))*(\"actualexpense.tax\"/100))"
},
```

3- Reload Segment

4- Edit table change a formula like
```
{
"columnName": "actualexpense.amountExcludingTax",
"transformFunction": "\"actualexpense.amountIncludingTax\"-((\"actualexpense.amountIncludingTax\"/(1+(\"actualexpense.tax\"/100)))*(\"actualexpense.tax\"/100))-1000"
},
```
5- Reload Segment

Here come my issue my -1000 does not appear in results except in consuming segments. Values should be backfilled as my understanding with the -1000 value

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the supplied schema and table formula changes, including reloading the segment after each edit, and compare results in the derived and consuming segments. Trace the segment reload path for derived columns; done means the updated formula, including the -1000 change, is reflected in the derived-column values after reload.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.