ArabicRootsAnalyzer [LUCENE-4293]
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
ArabicRootsAnalyzer is using an index of Arabic terms associated with its roots. each Arabic word has a root. There is no automatic way of deciding the root.
This Analyzer will match any term with its root, searching/indexing will be based on roots. It gives me great results in my application.
attached all the required files with the db. the problem with it is the size of the db (16MB). number of terms is around 300,000. I have another db with 600,000 but the attached one is summarized and better i believe.
---
Migrated from [LUCENE-4293](https://issues.apache.org/jira/browse/LUCENE-4293) by Ibrahim
Attachments: [ArabicRootFilter.java](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-4293/ArabicRootFilter.java), [ArabicRootsAnalyzer.java](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-4293/ArabicRootsAnalyzer.java), [ArabicTokenizer.java](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-4293/ArabicTokenizer.java), [ArabicTokens.txt](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-4293/ArabicTokens.txt), [rootsTableIndex.zip](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-4293/rootsTableIndex.zip)
Contributor guide
Research direction
Review the attached ArabicRootFilter.java, ArabicRootsAnalyzer.java, ArabicTokenizer.java, ArabicTokens.txt, and rootsTableIndex.zip first. The issue proposes root-based Arabic searching but does not define an integration point, acceptance criteria, or resolution for the 16MB database, so those requirements need clarification before implementation can be considered done.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- search
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100