apache / apache/lucene

nori > special(symbol) characters issue [LUCENE-8693]

Open
#9,739 2 comments 0 reactions 0 assignees View on GitHub
affects-version:7.6 legacy-jira-priority:Major module:analysis type:bug
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

Hi

I'm using the "nori" analyzer.
Whether it's an error or an intentional question.

All special characters are filtered.

Special characters stored in the dictionary are also filtered.

How do I print special characters?

thanks.

---
Migrated from [LUCENE-8693](https://issues.apache.org/jira/browse/LUCENE-8693) by YOO JEONGIN, updated Feb 14 2019

Contributor guide

Open the contributing guide

Research direction

The issue identifies the nori analyzer but names no source files or tests. Start by reproducing how nori handles special characters, including characters present in its dictionary, and inspect the analyzer's tokenization behavior. Done means establishing whether filtering is intentional and documenting or correcting the expected handling of those characters.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.