apache / apache/arrow

If I can cimport the cython .pxd files from pyarrow directly

Open
#14,526 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

Recent days, I have develop a new dataset filesystem used in my company scope. But in the python environment my colleague use the dataset api and inject the filesystem which I have wrote. Hence I have to make a new python wrapper for the new filesystem. But I am a newbie of cython I don't know if I can cimport the .pxd files from the pyarrow I have installed (built with my filesystem)

example is that

```python
# my/path/to/filesystem.pyx

# I don't know if this statement is valid ?
from pyarrow.includes.common cimport *
```

Contributor guide

Open the contributing guide

Research direction

Start by checking the installed pyarrow.includes.common .pxd path and the example my/path/to/filesystem.pyx. Verify whether a downstream Cython module can cimport those files from an installed PyArrow build, then document the supported import and build requirements, or clarify that this use is unsupported.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.