lincc-frameworks / lincc-frameworks/nested-pandas
Support list-view arrow arrays
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 26
- Forks
- 8
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 9
Description
**Feature request**
I have never seen list-view types in the wild, but they exist in pyarrow, and we probably should support conversion from them into Nested.
https://arrow.apache.org/docs/python/generated/pyarrow.ListViewType.html
https://arrow.apache.org/docs/python/generated/pyarrow.LargeListViewType.html
**Before submitting**
Please check the following:
- [x] I have described the purpose of the suggested change, specifying what I need the enhancement to accomplish, i.e. what problem it solves.
- [x] I have included any relevant links, screenshots, environment information, and data relevant to implementing the requested feature, as well as pseudocode for how I want to access the new functionality.
- [ ] If I have ideas for how the new feature could be implemented, I have provided explanations and/or pseudocode and/or task lists for the steps.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the linked pyarrow ListViewType and LargeListViewType documentation, then locate the existing conversion path from PyArrow types into Nested. Done means both list-view types convert successfully into Nested, with coverage for their distinct forms.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100