apache / apache/arrow

[Python] A standard field/column description in metadata

Open
#48,696 2 comments 0 reactions 0 assignees View on GitHub
Component: Python Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the enhancement requested

Hello,

From what I understand, we can add custom metadata with a key pair system like described here :
https://arrow.apache.org/docs/python/generated/pyarrow.Field.html#pyarrow.Field.with_metadata

This is very powerful but what would be even better for interoperability to also have a field/column description with a standardized name.
Field description is probably the most common metadata, it exists in SQL, in most of industry software such as Tableau, Alteryx, Dataïku and it would definitly help to have it with a standard name in Arrow

(please note I asked for the same enhancement for Apache parquet here : https://github.com/apache/parquet-format/issues/447 )

Best regards,

Simon

### Component(s)

Python

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.