apache / apache/pinot

question about adding a new field

Open
#10,309 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 55m
Merged PRs (30d)
182

Description

I used to add a field in pinot table schema and then I reload all segments, then I use "select * from table limit 10" and see the new field is already added. However, the value of the new field is always null (i.e. the default value of the field).

Since I am new to pinot, I am quite confused, is that related to segment flush strategy? For example, if I set the flushing time to 3h, does it mean I can only see the value in 3h?

Contributor guide

Open the contributing guide

Research direction

Start with Pinot table-schema changes, segment reload behavior, and the reported SELECT * query, then check how a three-hour flush interval affects newly added fields. Reproduce the field remaining null after a reload and determine whether new ingestion or waiting for the flush interval is required; done means documenting the observed behavior and its cause.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.