cockroachdb / cockroachdb/cockroach

tsearch: support all token types in text search parser

Open
#97,669 0 comments 0 reactions 0 assignees View on GitHub
C-enhancement T-sql-foundations
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

The default "text search parser" in Postgres supports many different token types, outlined here: https://www.postgresql.org/docs/current/textsearch-parsers.html

Our initial implementation will only support the ascii token type. This issue tracks enhancing the parser (see the `TSParse` function) to support the missing token types.

Part of #41288

Jira issue: CRDB-24808

Epic CRDB-60811

Contributor guide

Open the contributing guide

Research direction

Start with the TSParse function and compare its current behavior with the PostgreSQL text search parser documentation linked in the issue. Identify the token types beyond ascii that are missing, then verify that the parser supports them consistently with the documented behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, postgresql
Domain
databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.