apache / apache/kvrocks

Support full-text searching in Kvrocks Search

Open
#2,419 8 comments 0 reactions 0 assignees View on GitHub
enhancement help wanted
Dominant language
C++
Stars
4.4k
Forks
658
Avg merge
1d 20h
Merged PRs (30d)
10

Description

### Search before asking

- [X] I had searched in the [issues](https://github.com/apache/kvrocks/issues) and found no similar issues.

### Motivation

This includes:
- Implementing full-text indexing algorithms, such as inverted index, etc.
- Implementing word tokenization algorithms, which may include languages other than English, such as Chinese.
- Adding full-text indexing support for KQIR Indexer.
- Implementing the executor for full-text indexing and adding support in IR optimizer.
- Supporting relevant syntax parsing in front-end languages (SQL, RediSearch query).

Refer to:
https://github.com/pisa-engine/pisa
https://clucene.sourceforge.net/
https://redis.io/docs/latest/develop/interact/search-and-query/query/full-text/

### Solution

_No response_

### Are you willing to submit a PR?

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the referenced PISA, CLucene, and Redis full-text search materials, then locate the KQIR Indexer, IR optimizer, and SQL/RediSearch parsing entry points. Done would require coordinated indexing, tokenization, execution, optimization, and syntax support across these areas.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, redis
Domain
databases, search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.