apache / apache/accumulo

Place limit on fence begin and end row size.

Open
#3,795 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
1.2k
Forks
487
Avg merge
4d 5h
Merged PRs (30d)
13

Description

The fence concept provided as part of the no-chop merges places start row and end row data associated with a metadata file reference to fence off sections of files.

There should be an maximum limit on the number of bytes that these values can hold. On possibility may be to use the TABLE_MAX_END_ROW_SIZE property that was introduced in 1.7.0. Currently the default is 10K.

Allowing unbounded values would likely lead to performance issues reading, processing and storing the fence information as it grows larger.

Contributor guide

Open the contributing guide

Research direction

Start by tracing how fence start-row and end-row values are read, processed, and stored for metadata file references, then compare that path with the TABLE_MAX_END_ROW_SIZE property introduced in 1.7.0. Done means both fence row values have a defined maximum and oversized values are handled consistently without unbounded processing or storage.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.