lincc-frameworks / lincc-frameworks/hyrax

Eliminate the concept of metadata tables in dataset classes

Open
#861 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
41
Forks
7
Avg merge
5d 1h
Merged PRs (30d)
8

Description

Supporting metadata tables made a lot of sense at the beginning of the project, but with HyraxQL and dataset class `getter` methods we can treat metadata in a more consistent way than we did before. At this point they feel like a sidecar on the rest of the dataset and are treated differently from the rest of the data.

We should review the locations where we make use of metadata (hopefully just HSCDataset and possibly LSSTDataset, and implement regular or dynamically generated `get_` methods for the metatdata tables associated with the datasets.

Regarding visualization specifically, we wouldn't need to load the specific columns from metadata before hand, we could augment the UI such that a selectable list of available columns is shown that would 1) allow the user to see all available metadata/columns available 2) update the selected columns in real time (since visualize can interface with HyraxQL on the backend without the user having to modify configurations)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing metadata-table usage in HSCDataset and, if applicable, LSSTDataset, along with the dataset-class getter methods and HyraxQL integration. Trace how visualization currently loads metadata columns. Done means metadata is exposed through regular or dynamically generated getters and visualization can list available columns and update selections through HyraxQL.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.