lance-format / lance-format/lance

Support GRPC based api to return parts of manifest in lance or lance namespace

Open
#4,982 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

A-namespace enhancement
Dominant language
Rust
Stars
7.1k
Forks
852
Avg merge
3d 18h
Merged PRs (30d)
272

Description

The manifest can become too large if there are millions of files. An optional GRPC setup where a service (catalog etc) can return parts of the manifest would be great.

Just thinking out loud here, all manifest-related operations such as conflict handling and updates could be abstracted behind an interface that a future catalog service would implement.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named in the issue. Start by mapping the existing manifest operations and deciding where a gRPC/catalog interface belongs; done would require an agreed service boundary and concrete scope for partial manifest reads, conflict handling, and updates.

Written by the indexing model from the issue text.

Assessment

Tech stack
grpc, rust
Domain
api, backend-api-design, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.