Insufficient memory to continue the execution of the program
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 25/100
Research direction
Start by reproducing the reported tantivy index commands on Windows 11 with the cited -t and -m values, using wiki-articles.json as input. Compare the failures at the command boundary and verify that a supported memory configuration completes indexing without the reported errors.
Written by the indexing model from the issue text.
Description
I have Window 11 with 64GB RAM onboard. I was trying to execute the program with parameters below and got the error about insufficient memory. Also I tried to execute the program without -t, -m parameters - and the issue is the same.
cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 8 -m 8000000000
Program 'tantivy.exe' failed to run: Insufficient memory to continue the execution of the program.At line:1 char:26
- ... articles.json | tantivy index -i ./wikipedia-index -t 8 -m 8000000000
-
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~.
At line:1 char:1
- cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 8 -m 8 ...
-
+ CategoryInfo : ResourceUnavailable: (:) [], ApplicationFailedException + FullyQualifiedErrorId : NativeCommandFailed
Also tried this:
cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 1 -m 36000000000
Indexing failed : InvalidArgument("The memory arena in bytes per thread cannot exceed 4293967295")
Program 'tantivy.exe' failed to run: Insufficient memory to continue the execution of the program.At line:1 char:26
- ... rticles.json | tantivy index -i ./wikipedia-index -t 1 -m 36000000000
-
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~.
At line:1 char:1
- cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 1 -m 3 ...
-
+ CategoryInfo : ResourceUnavailable: (:) [], ApplicationFailedException + FullyQualifiedErrorId : NativeCommandFailed
And this:
cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 1 -m 4293967294
Program 'tantivy.exe' failed to run: Insufficient memory to continue the execution of the program.At line:1 char:26
- ... articles.json | tantivy index -i ./wikipedia-index -t 1 -m 4293967294
-
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~.
At line:1 char:1
- cat wiki-articles.json | tantivy index -i ./wikipedia-index -t 1 -m 4 ...
-
+ CategoryInfo : ResourceUnavailable: (:) [], ApplicationFailedException + FullyQualifiedErrorId : NativeCommandFailed
- Dominant language
- Rust
- Stars
- 404
- Forks
- 70
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from quickwit-oss/tantivy-cli
-
Difficulty 2/5 1-3 hours Newbie friendliness 55/100
quickwit-oss/tantivy-cli#115 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 45/100
quickwit-oss/tantivy-cli#114 · 3 reactions ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 55/100
quickwit-oss/tantivy-cli#110 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
quickwit-oss/tantivy-cli#105 ·
-
Broken with nightly Open
quickwit-oss/tantivy-cli#104 · 3 comments · 1 assignee ·
All issues in quickwit-oss/tantivy-cli
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
kwakseongjae/auto-hwp#319 ·
-
area:cli bug filter-quality good first issue priority:medium
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
-
Difficulty 1/5 Under an hour Newbie friendliness 72/100
bevyengine/bevy#25861 ·
-
comp-datalake
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
ClickHouse/ClickHouse#121222 ·
-
enhancement remote
Difficulty 2/5 1-3 hours Newbie friendliness 68/100