apache / apache/solr-orbit-workloads
geonames: add non-ASCII/international query terms
- Dominant language
- Python
- Stars
- 2
- Forks
- 4
- Avg merge
- 3h 43m
- Merged PRs (30d)
- 3
Description
`geonames/terms.txt` contains 45 ASCII-only place names. The Geonames dataset is global and includes names in Arabic, Chinese, Japanese, Cyrillic, and accented Latin scripts. The current terms do not exercise Solr's Unicode text analysis pipeline.
## Tasks
- Extend `terms.txt` with a representative set of non-ASCII place names drawn from the corpus
- Verify the existing analyzer chain handles them correctly (tokenisation, lowercasing, stop words)
**File:** `geonames/terms.txt`
Contributor guide
Research direction
Start with geonames/terms.txt and the referenced Geonames corpus; inspect the current 45 entries and analyzer behavior for representative Arabic, Chinese, Japanese, Cyrillic, and accented Latin terms. Done means terms.txt includes representative corpus names and verification covers tokenisation, lowercasing, and stop words.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- search
- Domain
- search
- Issue type
- Feature
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 74/100