opensearch-project / opensearch-project/data-prepper

parse_json processor enhancements

Open
#5,758 0 comments 0 reactions 1 assignee View on GitHub

@kkondaka is already working on this.

Since Jun 10, 2025.

Dominant language
Java
Stars
374
Forks
354
Avg merge
3d 18h
Merged PRs (30d)
8

Description

Is your feature request related to a problem? Please describe.
parse_json processor should provide an options to do key manipulations

Describe the solution you'd like
Data Prepper doesn't support some characters in keys. For example space character is not supported in keys. To avoid failures during json parsing, provide option to replace some characters/strings with other characters or strings. Taking "translate" processor config as example, provide map option to map strings to replacements string like shown below

  processor:
     - parse_json:
         <other existing config options>
         replace_map:
             " ": "_"
             "-": "_"

optionally, parse_json can also provide option to convert all keys to lower_case/upper_case.

Describe alternatives you've considered (Optional)
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.