apache / apache/hamilton

Add data source sinks for Polars Lazyframe implementation

Open
#791 1 comment 0 reactions 0 assignees View on GitHub
enhancement good first issue i/o
Dominant language
Jupyter Notebook
Stars
2.6k
Forks
213
PR merge metrics
No merged PRs in 30d

Description

The polars integration is missing a number of datasource sinks on the output side, this would allow users to write LazyFrames without running a lf.collect() and is likely more performant in a number of cases.

Sinks are:

- [ ] sink_parquet
- [ ] sink_csv
- [ ] sink_ipc (feather)
- [ ] sink_ndjson (don't have load support yet)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.