nori > special(symbol) characters issue [LUCENE-8693]
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
Hi
I'm using the "nori" analyzer.
Whether it's an error or an intentional question.
All special characters are filtered.
Special characters stored in the dictionary are also filtered.
How do I print special characters?
thanks.
---
Migrated from [LUCENE-8693](https://issues.apache.org/jira/browse/LUCENE-8693) by YOO JEONGIN, updated Feb 14 2019
Contributor guide
Research direction
The issue identifies the nori analyzer but names no source files or tests. Start by reproducing how nori handles special characters, including characters present in its dictionary, and inspect the analyzer's tokenization behavior. Done means establishing whether filtering is intentional and documenting or correcting the expected handling of those characters.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- search
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100