lance-format / lance-format/lance

FTS in SQL

Open
#4,520 1 comment 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

A-index enhancement
Dominant language
Rust
Stars
7.1k
Forks
852
Avg merge
3d 18h
Merged PRs (30d)
272

Description

This is related to https://github.com/lancedb/lance/issues/1782 but while that issue mostly discusses vector search this issue can be for full text search.

There are a few broad approaches (more discussion in the linked issue):

  • The FTS search could be recognized automatically from a standard SQL query (e.g. with a sort and order by)
  • The FTS search could be recognized via a UDTF
  • The FTS search could be recognized as a custom table provider

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the linked issue 1782 and its discussion of vector search. Compare the three proposed approaches—standard SQL recognition, a UDTF, and a custom table provider—and determine the scope needed for full-text search in SQL. Done should mean that one approach is selected and the corresponding implementation is complete.

Written by the indexing model from the issue text.

Assessment

Tech stack
sql
Domain
databases, search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.