apache / apache/arrow

[C++][Compute] Add option to return null values for nonexistent and ambiguous times

Open
#29,022 1 comment 0 reactions 0 assignees View on GitHub
Component: C++ Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

ARROW-13033 Implements TzLocalize kernel and can handle ambiguous and nonexistent times by raising or shifting backwards or forwards to first valid local time.
However we might want to be able to return null in these cases.
We could implement new flags to do so:
`compute::TemporalLocalizationOptions::Nonexistent::NONEXISTENT_IGNORE` and `compute::TemporalLocalizationOptions::Ambiguous::AMBIGUOUS_IGNORE`

**Reporter**: [Rok Mihevc](https://issues.apache.org/jira/browse/ARROW-13347) / @rok
**Watchers**: [Rok Mihevc](https://issues.apache.org/jira/browse/ARROW-13347) / @rok

**Note**: *This issue was originally created as [ARROW-13347](https://issues.apache.org/jira/browse/ARROW-13347). Please see the [migration documentation](https://github.com/apache/arrow/issues/14542) for further details.*

Contributor guide

Open the contributing guide

Research direction

Start by reading the TzLocalize kernel and compute::TemporalLocalizationOptions described in the issue. Trace how ambiguous and nonexistent times currently raise or shift, then identify the relevant tests. Done means the new NONEXISTENT_IGNORE and AMBIGUOUS_IGNORE options return null values for those cases.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.