opensearch-project / opensearch-project/data-prepper
parse_json processor enhancements
@kkondaka is already working on this.
Since Jun 10, 2025.
- Dominant language
- Java
- Stars
- 374
- Forks
- 354
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 8
Description
Is your feature request related to a problem? Please describe.
parse_json processor should provide an options to do key manipulations
Describe the solution you'd like
Data Prepper doesn't support some characters in keys. For example space character is not supported in keys. To avoid failures during json parsing, provide option to replace some characters/strings with other characters or strings. Taking "translate" processor config as example, provide map option to map strings to replacements string like shown below
processor:
- parse_json:
<other existing config options>
replace_map:
" ": "_"
"-": "_"
optionally, parse_json can also provide option to convert all keys to lower_case/upper_case.
Describe alternatives you've considered (Optional)
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.