elastic / elastic/relevance-studio

Feature Request: Include Execution Time for Each Strategy in Test Results

Open
#12 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
42
Forks
18
Avg merge
1d 7h
Merged PRs (30d)
4

Description

In the current test result view, we can see metrics like NDCG for different strategies, which is the main purpose of this excellent evaluation tool. One of our customers is using Relevance Studio and would like to be able to compare execution time alongside the different relevance metrics.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points. Start by locating the test-result view and the code that runs each relevance strategy, then determine where existing NDCG metrics are assembled; done means displaying comparable execution-time data for each strategy alongside the current relevance metrics.

Written by the indexing model from the issue text.

Assessment

Tech stack
elasticsearch, python
Domain
search, testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.