opensearch-project / opensearch-project/data-prepper
[Enhancement] Support custom index template for ES 6 in opensearch sink
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 374
- Forks
- 354
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 8
Description
Is your feature request related to a problem? Please describe.
Currently the index_type defaults to management_disabled when distribution_version is set to es6. This is due to old index mapping schema in ES 6:
org.opensearch.client.opensearch._types.OpenSearchException: Request failed: [illegal_argument_exception] Malformed [mappings] section for type [dynamic_templates], should include an inner object describing the mapping
at org.opensearch.client.transport.aws.AwsSdk2Transport.parseResponse(AwsSdk2Transport.java:492) ~[opensearch-java-2.5.0.jar:?]
Describe the solution you'd like
A clear and concise description of what you want to happen.
Describe alternatives you've considered (Optional)
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing how the OpenSearch sink handles index_type and distribution_version for ES 6, using the reported malformed mappings error as the initial symptom. The issue does not name files, tests, or a precise template configuration; completion would require defining custom index-template behavior and verifying that ES 6 mappings are accepted.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- backend, search
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100