oceanbase / oceanbase/seekdb

[Question]: Regarding Filtered Vector Search indexing and SSTable storage layout

Open
#176 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

type: question
Dominant language
C++
Stars
2.9k
Forks
339
Avg merge
1d 19h
Merged PRs (30d)
52

Description

I am evaluating SeekDB's performance in hybrid analytical and vector search scenarios. I have two specific questions regarding the underlying architecture:

  1. Support for Hybrid/Filtered Vector Search Indexing:
    Does SeekDB currently support a unified hybrid index for filtered vector searches? Specifically, can the engine utilize both scalar filters and vector indexes simultaneously (e.g., using a single index structure or a bitmap-based pre-filter) to avoid the "pre-filtering vs. post-filtering" performance bottleneck?

  2. Data Layout in SSTables:
    How are scalar data and vector data physically stored within the SSTables?

Are they stored in-row (scalar and vector attributes residing together in the same data block/row)?

Or are they stored in a decoupled/columnar fashion (vectors stored in a separate area/file from the scalar attributes) to optimize disk I/O during large-scale scans?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named. Investigate the filtered vector-search indexing path and SSTable storage layout; done means documenting whether scalar and vector filtering or indexes are combined and how scalar and vector data are physically stored.

Written by the indexing model from the issue text.

Assessment

Domain
databases, search
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.