mhkeller / mhkeller/layercake

Support for arrow data via flechette

Open
#436 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Svelte
Stars
1.8k
Forks
42
Avg merge
11h 43m
Merged PRs (30d)
9

Description

LayerCake is pretty tied to the idea that your data is an array of objects (or a POJO in the form of a GeoJSON Feature Collection). But it would be nice if you could pass a Flechette Table, loaded from a parquet or arrow file, and get the same kind of convenience functions.

Instead of looping through a data array, you would likely create a loop out of the total length and then access the data in column vectors. I'd probably defer working with proxies until a v2 but that would give even more performance gains.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by examining how LayerCake currently handles arrays of objects and GeoJSON Feature Collections, then compare that with the Flechette Table described in the issue. Done means a Flechette Table loaded from parquet or Arrow data can provide the same convenience functions, without requiring proxy support.

Written by the indexing model from the issue text.

Assessment

Domain
data-visualization
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.