apache / apache/hudi

Add vector index options and Spark DDL scaffolding

Open
#19,096 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Parent: #19094
Related: #18676

## Summary
Add the Spark DDL and option surface for vector indexes.

## Scope
- `CREATE INDEX ... USING VECTOR`
- vector option parsing and validation
- metric and quantizer options
- `vector.rabitq.total_bits`
- lifecycle entry points for create/drop/show/validation

## Acceptance Criteria
- option surface is defined and validated
- invalid configurations fail early
- DDL scaffolding is separated from payload and execution logic

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading parent issue #19094 and related issue #18676 to establish the intended vector-index design and boundaries. Use the stated scope and acceptance criteria as the completion checklist: Spark DDL and options are defined and validated, invalid configurations fail early, and lifecycle scaffolding remains separate from payload and execution logic.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.