locationtech / locationtech/geomesa
Accumulo - Add an IndexWriter that provides raw mutations for use in m/r
Nobody has claimed this yet.
- Dominant language
- Scala
- Stars
- 1.5k
- Forks
- 446
- Avg merge
- 1d 8h
- Merged PRs (30d)
- 31
Description
Accumulo - Add an IndexWriter that provides raw mutations for use in m/r
The current IndexWriter uses a BatchWriter. We could have an alternative implementation that returns mutations for use in m/r jobs - that would encapsulate all the writing logic in the AccumuloIndexAdapter. See, e.g. AttributeIndexJob.
Original JIRA Issue: https://geomesa.atlassian.net/browse/GEOMESA-2545
Key: GEOMESA-2545
Type: Improvement
Priority: Major
Status: To Do
Resolution: Unresolved
Reporter: Emilio Lahr-Vivaz
Created: Tue, 5 Feb 2019 09:09:56 -0500
Updated: Tue, 5 Feb 2019 09:10:07 -0500
Affects Version(s): 2.3.0
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the current IndexWriter and the AccumuloIndexAdapter, then compare the AttributeIndexJob example mentioned in the issue. Determine how an alternative writer can expose raw mutations for map/reduce use while keeping writing logic in the adapter. Done means the adapter supports this mutation-producing path without relying on a BatchWriter.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala
- Domain
- databases, distributed-systems
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100