apache / apache/lucene

Create benchmark & approach for testing Lucene's near real-time performance [LUCENE-2061]

Open
#3,137 9 comments 0 reactions 1 assignee Claimed by @mikemccand View on GitHub
legacy-jira-priority:Minor module:core/index type:task
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

With the improvements to contrib/benchmark in #3126, it's now
possible to create compelling algs to test indexing & searching
throughput against a periodically reopened near-real-time reader from
the IndexWriter.

Coming out of the discussions in #2600, I think to properly
characterize NRT, we should measure net search throughput as a
function of both reopen rate (ie how often you get a new NRT reader
from the writer) and indexing rate. We should also separately measure
pure adds vs updates (deletes + adds); the latter is much more work
for Lucene.

This can help apps make capacity decisions... and can help us test
performance of pending improvements for NRT (eg #2390,
LUCENE-2047).

---
Migrated from [LUCENE-2061](https://issues.apache.org/jira/browse/LUCENE-2061) by Michael McCandless (@mikemccand), updated Nov 29 2009
Attachments: [LUCENE-2061.patch](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-2061/LUCENE-2061.patch) (versions: 3)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.