opensearch-project / opensearch-project/OpenSearch

[Feature Request] Segment Profiling

Open
#20,344 9 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement Search
Dominant language
Java
Stars
13.7k
Forks
3k
Avg merge
2d 23h
Merged PRs (30d)
108

Description

Is your feature request related to a problem? Please describe

For concurrent segment searches, the profiling information is limited to the times for each phase in the query and the statistics across the slices. However, there are not information on the internals of the slices.

Describe the solution you'd like

Should there be information on the segments in each of the slices the query ran? With the incoming feature of intrasegment concurrent search worked on by @prudhvigodithi , should there also be information on the partitions of the segments search on?

Related component

Search

Describe alternatives you've considered

No response

Additional context

No response

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the existing profiling output for concurrent segment searches and the related intrasegment concurrent-search work mentioned in the issue. Trace how timings and slice statistics are collected, then determine the scope and format for reporting segment and partition details. Done means the requested profiling information is defined, implemented, and covered by appropriate tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.