apache / apache/solr-orbit-workloads

geonames: add non-ASCII/international query terms

Open Beginner friendly
#13 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2
Forks
4
Avg merge
3h 43m
Merged PRs (30d)
3

Description

`geonames/terms.txt` contains 45 ASCII-only place names. The Geonames dataset is global and includes names in Arabic, Chinese, Japanese, Cyrillic, and accented Latin scripts. The current terms do not exercise Solr's Unicode text analysis pipeline.

## Tasks
- Extend `terms.txt` with a representative set of non-ASCII place names drawn from the corpus
- Verify the existing analyzer chain handles them correctly (tokenisation, lowercasing, stop words)

**File:** `geonames/terms.txt`

Contributor guide

Open the contributing guide

Research direction

Start with geonames/terms.txt and the referenced Geonames corpus; inspect the current 45 entries and analyzer behavior for representative Arabic, Chinese, Japanese, Cyrillic, and accented Latin terms. Done means terms.txt includes representative corpus names and verification covers tokenisation, lowercasing, and stop words.

Written by the indexing model from the issue text.

Assessment

Tech stack
search
Domain
search
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
74/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.