JuliaArrays / JuliaArrays/StructArrays.jl
Huge performance hit on getindex with many Union{Missing, String} columns
Open
Nobody has claimed this yet.
- Dominant language
- Julia
- Stars
- 402
- Forks
- 49
- PR merge metrics
- No merged PRs in 30d
Description
Table with 3639 rows, 83 columns where 81 of them are of type Union{Missing,String}.
For me, tab[1] in fact never finishes compilation as far as I can tell.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the reported 3,639-row, 83-column table with 81 Union{Missing, String} columns and profiling tab[1]. There are no files or tests named in the issue; done means tab[1] no longer appears to hang during compilation and the performance impact is characterized.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100