apache / apache/accumulo

Ability to disable scan file limit in FileManager

Open
#1,606 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
1.2k
Forks
487
Avg merge
4d 5h
Merged PRs (30d)
13

Description

It seems the lock contention due to the file limit in FileManager is still an issue in 1.9. This problem has been around since https://issues.apache.org/jira/browse/ACCUMULO-416 which is a prerequisite for https://issues.apache.org/jira/browse/ACCUMULO-543. It would be worthwhile to revisit the first ticket and at the very least have a config option to disable the file limit lock.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing ACCUMULO-416 and the current FileManager implementation to understand how the scan file limit lock causes contention. Trace the existing configuration and locking behavior, then verify that a configuration option can disable the limit lock without disrupting scans and add coverage for the resulting behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases, distributed-systems, performance
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.