apache / apache/lucene

fix most memory-hungry tests [LUCENE-9241]

Open
#10,281 16 comments 0 reactions 0 assignees View on GitHub
legacy-jira-priority:Major type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

Currently each test jvm has Xmx of 512M. With a modern macbook pro this is 4GB which is pretty crazy.

On the other hand, if we fix a few edge cases, tests can work with lower heaps such as 128M. This can save many gigabytes (also it finds interesting memory waste/issues).

---
Migrated from [LUCENE-9241](https://issues.apache.org/jira/browse/LUCENE-9241) by Robert Muir (@rmuir), updated Mar 06 2020
Attachments: [LUCENE-9241.patch](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-9241/LUCENE-9241.patch)

Contributor guide

Open the contributing guide

Research direction

Start with the migrated LUCENE-9241 description and its attached LUCENE-9241.patch; no source files or test names are identified in the issue. Trace the tests using the 512M Xmx setting and the noted edge cases, then verify that the most memory-hungry tests run with a lower heap such as 128M without failures.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
performance, testing
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.