lance-format / lance-format/lance

feat: Support JSON as data type

Open
#4,516 9 comments 10 reactions 1 assignee View on GitHub

@Xuanwo is already working on this.

Since Aug 20, 2025.

enhancement epic
Dominant language
Rust
Stars
7.1k
Forks
852
Avg merge
3d 18h
Merged PRs (30d)
272

Description

Support JSON as data type

Users are expecting to store schema less json blobs in the dataset. In other systems,

  • Postgres can use jsonb type
  • Spark offers functions, such as get_json_object / json_object_keys function on json strings.
  • Pyarrow has JsonType now

It'd be beneficial for Lance to have capability to store, access and search json objects.

  • Store JSON as one of the arrow field.
  • Implement reading values by key or json path.
  • Create index on one of the scalar field.
  • Search a scalar json field
  • Create vector index on one of vector field.
  • Search a vector json field
  • Create full text index on one of the string field.
  • Search a fulltext json field.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.