apache / apache/lucene

Add support for BM25's k3 parameter to query parsers

Open
#15,768 1 comment 0 reactions 0 assignees View on GitHub
type:task
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

### Description

Currently, duplicate terms in query strings see their scores boosted by their number of occurrences. It would likely be better to saturate the contribution of such repeated terms, as suggested in the original BM25 paper through the k3 tuning parameter.

From a quick survey, k3 seems to often default to 7 or 8, see e.g. Terrier: https://github.com/terrier-org/terrier-core/blob/54e6faf802bb6275b53ad6de14a93a53389719b8/modules/core/src/main/java/org/terrier/matching/models/BM25.java#L48.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.