Add config to replace nulls with default value at ingestion time instead of relying on system wide config
Open
Area - Null Handling
stale
- Dominant language
- Java
- Stars
- 14.1k
- Forks
- 3.8k
- Avg merge
- 2d 31m
- Merged PRs (30d)
- 209
Description
Review comment from Gian -
Add configs for to enable following behavior
- Ingestion-side, replace nulls with default values.
- Query-side, respect nulls if they are present in storage.
This allows the default configuration to be speedy (no nulls), while also allowing people to take advantage of more powerful null handling without too much work (they just need to change the storage-side config). Importantly, people don't need to set a cluster-wide config that changes the behavior for all datasources and all columns.
Contributor guide
Assessment
This issue has not been assessed yet.