apache / apache/lucene

Reduce per-field heap usage for indexed fields [LUCENE-6199]

Open
#7,261 19 comments 0 reactions 1 assignee Claimed by @mikemccand View on GitHub
legacy-jira-fix-version:5.2 legacy-jira-fix-version:6.0 legacy-jira-priority:Major type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

Lucene uses a non-trivial baseline bytes of heap for each indexed
field, and I know it's abusive for an app to create 100K indexed
fields but I still think we can and should make some effort to reduce
heap usage per unique field?

E.g. in block tree we store 3 BytesRefs per field, when 3 byte[]s
would do...

---
Migrated from [LUCENE-6199](https://issues.apache.org/jira/browse/LUCENE-6199) by Michael McCandless (@mikemccand), 1 vote, updated May 09 2016
Attachments: [LUCENE-6199.patch](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-6199/LUCENE-6199.patch) (versions: 2)
Sub-tasks:
- #7378
- #7379
- #7386

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.