apache / apache/lucene

Arabic Stemmer improvement for Better Search Accuracy [LUCENE-8028]

Open
#9,076 11 comments 0 reactions 0 assignees View on GitHub
legacy-jira-label:Arabic legacy-jira-label:improvement legacy-jira-label:stemmer legacy-jira-priority:Major type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

HI, this is Ayah - bidi developer at IBM Egypt - Globalization Team, we are responsible to support Arabic at IBM products and services and as we use lucence at many of services, we found that it needs major improvement at Arabic stemmer, we implement the following two papers https://dl.acm.org/citation.cfm?id=1921657 and http://waset.org/publications/10005688/arabic-light-stemmer-for-better-search-accuracy to improve lucene arabic stemmer function and would like to open a Pull request to let you integrate it as a part of lucene

---
Migrated from [LUCENE-8028](https://issues.apache.org/jira/browse/LUCENE-8028) by Ayah Shamandi, updated Dec 06 2017

Contributor guide

Open the contributing guide

Research direction

Start by reviewing Lucene’s current Arabic stemmer function and the two linked papers. The issue does not name source files or tests; completion would require evaluating the proposed stemming implementation and providing a pull request that integrates it for improved Arabic search accuracy.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.