apache / apache/pinot

Overview for "text search" topic

Open
#12,427 4 comments 0 reactions 0 assignees View on GitHub
parent-issue stale
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 55m
Merged PRs (30d)
182

Description

At this time, it's a little hard to build a complete picture of the field of "text search" topic in Pinot with
- available capabilities,
- ongoing efforts,
- ideas and
- plans

even after having checked the docs
- https://docs.pinot.apache.org/basics/indexing/text-search-support
- https://docs.pinot.apache.org/basics/indexing/native-text-index#searching-native-text-indices

and having went through many issues and PRs....

=> Would be great to keep and maintain a good overview on this "text search" topic by e.g.
- aggregating all text search related topics/issues/ into one master/parent/top-level issue,
- adding a new grouping label (e.g. `FTS` for full text search, similar to `upsert` label)
- ...

One can find several ones when searching, e.g. for
- "full text" (5/1): https://github.com/apache/pinot/issues?q=is%3Aissue+%22full+text%22+
- #10934
- #7395
- #7218
- #2798
- "text search" (14/6): https://github.com/apache/pinot/issues?q=is%3Aissue+%22text+search%22
- "lucene" (22/8): https://github.com/apache/pinot/issues?q=is%3Aissue+lucene
- "embeddings" (3/0): https://github.com/apache/pinot/issues?q=is%3Aissue+embeddings
- #10919
- #7218
- ...

There are really many issues/pull requests and some are
- relatively old,
- partly done,
- waiting for merge
- overlapping
- ...

A great full text search is of course complex, but imho pretty rewarding and could be a huge step for Pinot.
Having a good overview, could be a valuable step...

Contributor guide

Open the contributing guide

Research direction

Start with the text-search documentation at docs.pinot.apache.org/basics/indexing/text-search-support and docs.pinot.apache.org/basics/indexing/native-text-index#searching-native-text-indices, then review the related issues and pull requests listed in #12427. Done means producing and maintaining a clear overview of capabilities, ongoing work, ideas, and plans, with related items grouped as appropriate.

Written by the indexing model from the issue text.

Assessment

Domain
documentation, search
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.