astronomy-commons / astronomy-commons/lsdb-server

Suppress file-level key-value metadata

Open
#13 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
2
Forks
1
PR merge metrics
No merged PRs in 30d

Description

For VOParquet files, each leaf parquet file *may* contain the same VO metadata inside the file-level metadata. This is plain text, and has the potential to be large.

The metadata should be present in `_common_metadata` and `_metadata` files, however, and can be cached on the client side. It would be helpful to (optionally) suppress sending that additional metadata over the wire.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files or tests are named. Start by locating the server path that reads VOParquet leaf-file metadata and sends it over the wire, then inspect how `_common_metadata` and `_metadata` are handled. Done means an optional setting suppresses the repeated file-level metadata while preserving the shared metadata behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.