question about adding a new field
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 2d 55m
- Merged PRs (30d)
- 182
Description
I used to add a field in pinot table schema and then I reload all segments, then I use "select * from table limit 10" and see the new field is already added. However, the value of the new field is always null (i.e. the default value of the field).
Since I am new to pinot, I am quite confused, is that related to segment flush strategy? For example, if I set the flushing time to 3h, does it mean I can only see the value in 3h?
Contributor guide
Research direction
Start with Pinot table-schema changes, segment reload behavior, and the reported SELECT * query, then check how a three-hour flush interval affects newly added fields. Reproduce the field remaining null after a reload and determine whether new ingestion or waiting for the flush interval is required; done means documenting the observed behavior and its cause.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- databases
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100