opensearch-project / opensearch-project/data-prepper

Support nesting the entire document under a different key

Open
#4,617 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Java
Stars
374
Forks
354
Avg merge
3d 18h
Merged PRs (30d)
8

Description

Is your feature request related to a problem? Please describe.
As a user of Data Prepper, my Events look like this

{
 "key-one": "value-one",
 "key-two": "value-two"
}

and I would like them to look like this

{
  "new-key": {
       "key-one": "value-one",
       "key-two": "value-two"
   }
}

Describe the solution you'd like
A way to pass the root (or entire existing document) of an Event to json pointer expression. For example, this could be with /, allowing add_entries to add keys at the highest level with the existing document

Describe alternatives you've considered (Optional)
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names the add_entries processor and JSON Pointer expressions, but no files or tests. Start by tracing how add_entries resolves its target path and how the existing document is represented; confirm the behavior with the repository's current add_entries tests or examples. Done means an event can be nested under a new key while preserving its existing fields.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.