h2oai / h2oai/datatable

Support Pandas ExtensionTypes / PyArrow StructTypes

Open
#2,950 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
C++
Stars
1.9k
Forks
164
Avg merge
7h 31m
Merged PRs (30d)
1

Description

Hi, would it be possible to support Pandas ExtensionTypes like [IntervalArray](https://github.com/pandas-dev/pandas/blob/526468c8fe6fc5157aaf2fce327c5ab2a3350f49/pandas/core/arrays/interval.py#L190)s?

Right now, it is not possible to read any PyArrow table containing StructTypes using datatable.
Also, I would like to be able implementing my own extension types for advanced features like range joins.

Pandas ExtensionTypes allow implementing all of this for DataFrames.
A similar concept for datatable would ne nice :)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.