Explore Relevance Based Performance Benchmarks [LUCENE-8841]
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
While discussing improvements in relevance of fuzzy queries with @jimczi, the topic of how to measure impact of changes to relevance of common queries came up. While a non trivial effort, having such a benchmark will allow us to measure the impact of potential changes and also catch regressions well in time.
This Jira tracks ideas and efforts in that direction
---
Migrated from [LUCENE-8841](https://issues.apache.org/jira/browse/LUCENE-8841) by Atri Sharma (@atris), updated Jun 08 2019
Contributor guide
Research direction
Start by reviewing the migrated issue and its linked LUCENE-8841 Jira discussion, focusing on the proposed relevance benchmarks for fuzzy and other common queries. Define the benchmark scope and success criteria from that discussion; done means relevance changes can be measured and regressions can be detected in time.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- search
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100