opensearch-project / opensearch-project/OpenSearch

Support migrating indexes to data streams.

Open
#2,017 8 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

distributed framework enhancement
Dominant language
Java
Stars
13.7k
Forks
3k
Avg merge
2d 23h
Merged PRs (30d)
108

Description

Is your feature request related to a problem? Please describe.
OpenSearch supports both indexes and data streams. It would be good for users of an OpenSearch cluster to be able to seamlessly migrate their existing indexes to data stream.

Describe the solution you'd like
An API under _data_stream (.e.g., _data_stream/_migrate), that accepts a POST of the indexes to migrate to data streams.

Describe alternatives you've considered
I have been looking for a seamless way to migrate existing indexes to data streams (I want to take full advantage of data streams), without impacting the end-user experience. Not being able to migrate causes a poor user experience, as users may need to look at multiple data streams/indexes to get all their data.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with OpenSearch's existing data-stream APIs and the proposed _data_stream/_migrate entry point. Define how a POST naming indexes should migrate them without disrupting users, and verify that the migrated data is accessible through data streams as intended.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
api, backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.