Improve Metadata Table (MDT) compaction performance
Open
type:devtask
type:story
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
### Task Description
**What needs to be done:**
This story aims to improve the Metadata Table (MDT) compaction performance for indexes with large data, such as Record Level Index (RLI) and Secondary Index (SI).
**Why this task is needed:**
Better MDT compaction helps to trigger MDT compaction more frequent and improve ingestion performance, by reducing MDT compaction latency as part of the ingestion latency and improving point lookups with fewer log files.
### Task Type
Performance optimization
### Related Issues
_No response_
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.