apache / apache/arrow-julia

copy does not copy to standard Julia Types

Open
#495 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Julia
Stars
312
Forks
78
PR merge metrics
No merged PRs in 30d

Description

While the documentation says that a copy would ensure to have normal Julia Types

> df = copy(DataFrame(Arrow.Table(file))): Build a [DataFrame](https://juliadata.github.io/DataFrames.jl/stable/), where the columns are regular in-memory vectors (specifically, Base.Vectors and/or PooledVectors). This requires that you have enough memory to load the entire DataFrame into memory.

this is not the case

![image](https://github.com/apache/arrow-julia/assets/4255480/123150cd-75d9-4f35-b445-b4f105c1984e)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing `copy(DataFrame(Arrow.Table(file)))` and inspect the resulting column types against the documentation quoted in the issue. Trace the copy behavior from that entry point; done means the observed behavior and the documented expectation agree, with a regression check for the reported case.

Written by the indexing model from the issue text.

Assessment

Tech stack
julia
Domain
data
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.