apache / apache/arrow-julia

[Docs] Improve documentation around partitions/multithreading

Open
#401 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Julia
Stars
312
Forks
78
PR merge metrics
No merged PRs in 30d

Description

Following my [investigations](https://github.com/apache/arrow-julia/issues/393), it would be great to add more examples for beginners/new users on how to get the most performance from Arrow.jl by using multithreading.

I'm happy to draft a PR once we know if there will be any updates to the API (eg, https://github.com/apache/arrow-julia/pull/400)

In addition, it would be excellent to add some documentation for `DictEncoded` columns (eg, some rules of thumb for when to use it and a few examples)

Contributor guide

No contributing guide indexed for this repository

Research direction

Review issue 393 and pull request 400 first to understand the multithreading and partition API status. Then identify the documentation entry points for multithreading and DictEncoded columns, and add beginner examples, usage guidance, and rules of thumb that reflect the settled API.

Written by the indexing model from the issue text.

Assessment

Tech stack
julia
Domain
documentation, performance
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.