astronomy-commons / astronomy-commons/lsdb

Assigning a column to a catalog and its margin

Open
#171 1 comment 0 reactions 1 assignee Claimed by @dougbrn View on GitHub
enhancement interface
Dominant language
Python
Stars
55
Forks
26
Avg merge
4d 1h
Merged PRs (30d)
8

Description

In working to make sure that catalog methods also apply to the margin catalog, assign seems like a harder case. If a user is assigning a series that is partitioned to fit the catalog's partitions, then to apply the same column to the margin we would need to do some sort of join or map/reduce to rearrange the column to fit with the margin's partitions. I think this would be fairly inefficient and break a lot of the extremely parallel operations we have.

Alternatively, we could leave this to the user, and accept the catalog and margin columns separately to assign, but this then leaves the work on the user.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.