Overview for "text search" topic
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 2d 55m
- Merged PRs (30d)
- 182
Description
At this time, it's a little hard to build a complete picture of the field of "text search" topic in Pinot with
- available capabilities,
- ongoing efforts,
- ideas and
- plans
even after having checked the docs
- https://docs.pinot.apache.org/basics/indexing/text-search-support
- https://docs.pinot.apache.org/basics/indexing/native-text-index#searching-native-text-indices
and having went through many issues and PRs....
=> Would be great to keep and maintain a good overview on this "text search" topic by e.g.
- aggregating all text search related topics/issues/ into one master/parent/top-level issue,
- adding a new grouping label (e.g. `FTS` for full text search, similar to `upsert` label)
- ...
One can find several ones when searching, e.g. for
- "full text" (5/1): https://github.com/apache/pinot/issues?q=is%3Aissue+%22full+text%22+
- #10934
- #7395
- #7218
- #2798
- "text search" (14/6): https://github.com/apache/pinot/issues?q=is%3Aissue+%22text+search%22
- "lucene" (22/8): https://github.com/apache/pinot/issues?q=is%3Aissue+lucene
- "embeddings" (3/0): https://github.com/apache/pinot/issues?q=is%3Aissue+embeddings
- #10919
- #7218
- ...
There are really many issues/pull requests and some are
- relatively old,
- partly done,
- waiting for merge
- overlapping
- ...
A great full text search is of course complex, but imho pretty rewarding and could be a huge step for Pinot.
Having a good overview, could be a valuable step...
Contributor guide
Research direction
Start with the text-search documentation at docs.pinot.apache.org/basics/indexing/text-search-support and docs.pinot.apache.org/basics/indexing/native-text-index#searching-native-text-indices, then review the related issues and pull requests listed in #12427. Done means producing and maintaining a clear overview of capabilities, ongoing work, ideas, and plans, with related items grouped as appropriate.
Written by the indexing model from the issue text.
Assessment
- Domain
- documentation, search
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100