manticoresoftware / manticoresoftware/manticoresearch
Some conditions can lead to empty dictionary
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 12k
- Forks
- 642
- Avg merge
- 3d 12h
- Merged PRs (30d)
- 47
Description
Related to ticket #395.
Having all 3 on these
```
stopwords = sphinx_stopwords.txt
morphology = libstemmer_nl, lemmatize_en
index_exact_words = 1
```
leads to empty dictionary. Disabling one of the them, the dict is made and searches work. Also using 2 stemmers works fine.
I can't reproduce it on a dummy source (like a SELECT 1,'some text'), only when using the data of #379.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading related tickets #395 and #379, then reproduce the dictionary-generation failure using the data from #379 with stopwords, morphology, and index_exact_words enabled together. Compare the resulting dictionary and search behavior with configurations that disable one setting or use two stemmers. Done means the dictionary is generated and searches work with all three settings enabled.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- databases, search
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100