apache / apache/arrow-cookbook

Add recipe on converting a large CSV into a smaller one

Open
#130 0 comments 0 reactions 0 assignees View on GitHub
r
Dominant language
C++
Stars
108
Forks
49
Avg merge
2h 14m
Merged PRs (30d)
1

Description

Add a recipe which shows how to do `open_dataset()`...`write_dataset()`, and some extra text which explains why this is better than doing head/tail/awk from one giant csv to many smaller ones (i.e. things will go wrong with headers present or missing.)

Contributor guide

Open the contributing guide

Research direction

Start by locating the repository's existing recipe documentation and the entry points named in the issue: open_dataset() and write_dataset(). Add a recipe that demonstrates converting one large CSV into smaller ones, and explain why this avoids header problems that can occur with head, tail, or awk.

Written by the indexing model from the issue text.

Assessment

Domain
data-engineering, documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.