cockroachdb / cockroachdb/cockroach
tsearch: support all token types in text search parser
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
The default "text search parser" in Postgres supports many different token types, outlined here: https://www.postgresql.org/docs/current/textsearch-parsers.html
Our initial implementation will only support the ascii token type. This issue tracks enhancing the parser (see the `TSParse` function) to support the missing token types.
Part of #41288
Jira issue: CRDB-24808
Epic CRDB-60811
Contributor guide
Research direction
Start with the TSParse function and compare its current behavior with the PostgreSQL text search parser documentation linked in the issue. Identify the token types beyond ascii that are missing, then verify that the parser supports them consistently with the documented behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, postgresql
- Domain
- databases
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100