Revisit table object usage in readRecordKeysFromFileSliceSnapshot for record-level index
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
The table object instantiation can be heavy and it is used by record index only in the following method. We should revisit to see if this can be improved.
{code:java}
private static HoodieData readRecordKeysFromFileSliceSnapshot(HoodieEngineContext engineContext,
List> partitionFileSlicePairs,
int recordIndexMaxParallelism,
String activeModule,
HoodieTableMetaClient metaClient,
HoodieWriteConfig dataWriteConfig,
HoodieTable hoodieTable) {code}
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-9357
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-9176
- Fix version(s):
- 1.1.0
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.