apache / apache/hudi

Avoid calling values() on ExternalSpillableMap

Open
#16,782 1 comment 0 reactions 1 assignee Claimed by @nsivabalan View on GitHub
from-jira priority:critical type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

We should avoid calling values() and holding large collection in memory for ExternalSpillableMap. This defeats the purpose of disk based map structure. When iteration through the elements is required, we should implement iterators().

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8870
- Type: Task
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.