DirectoryTaxonomyReader.taxoArray占用内存较大导致系统OOM宕机 [LUCENE-9969]
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
首先数据量很大，jvm内存为90G，但是TaxonomyIndexArrays几乎占走了一半
请问对于TaxonomyReader是否有更好的使用方式或者其他的优化？
---
Migrated from [LUCENE-9969](https://issues.apache.org/jira/browse/LUCENE-9969) by FengFeng Cheng, updated Sep 24 2021
Attachments: [image-2021-05-24-13-43-43-289.png](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-9969/image-2021-05-24-13-43-43-289.png)
Pull requests: https://github.com/apache/lucene/pull/271
Contributor guide
Research direction
Start by reading DirectoryTaxonomyReader, TaxonomyReader, and TaxonomyIndexArrays, then review the linked LUCENE-9969 discussion and pull request. The issue reports that TaxonomyIndexArrays consumes much of a 90 GB JVM and asks for usage or optimization guidance, but it does not define a specific change or completion test.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- search
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100