lincc-frameworks / lincc-frameworks/nested-pandas

Optimize NestedFrame.__setitem__ with .nest.with_field

Open
#137 0 comments 1 reaction 0 assignees View on GitHub
enhancement performance
Dominant language
Python
Stars
26
Forks
8
Avg merge
2d 2h
Merged PRs (30d)
9

Description

The current implementation of `NestedFrame.__setitem__` flattens and packs the data back and forth. However there is a cheaper way of do the same job with `NestedAccessor.with_field`

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at NestedFrame.__setitem__ and inspect how its current implementation flattens and repacks data. Compare that path with NestedAccessor.with_field, then verify that using the accessor preserves the existing assignment behavior while avoiding the extra transformations.

Written by the indexing model from the issue text.

Assessment

Tech stack
pandas, python
Domain
data
Issue type
Refactor
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.