apache / apache/arrow-julia

support Dates.CompoundPeriod in deserialization?

Open
#494 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Julia
Stars
312
Forks
78
PR merge metrics
No merged PRs in 30d

Description

First time I am using Arrow with Dates.jl and unfortunatly immediately run into something which I expected to be supported.

When writing and reading a DataFrame with Dates durations like CompoundPeriod, Arrow does not automatically reconstruct the type. I know I can add my custom conversion rules, but is there a reason why this conversion rule is not there by default?

Concretely, my `Dates.CompoundPeriod` gets transformed into `NamedTuple{(:periods,), Tuple{Vector{Dates.Second}}}`

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported write-and-read path with a DataFrame containing a Dates.CompoundPeriod. Read the existing custom conversion rules and deserialization handling, then determine where the default rule should recognize the resulting NamedTuple. Done means deserialization automatically reconstructs Dates.CompoundPeriod without a custom conversion rule.

Written by the indexing model from the issue text.

Assessment

Tech stack
julia
Domain
data
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.