keplergl / keplergl/kepler.gl

Big data imports and processing

Open
#2,197 1 comment 3 reactions 1 assignee Claimed by @heshan0131 View on GitHub
Dominant language
TypeScript
Stars
12k
Forks
2k
Avg merge
1d 5h
Merged PRs (30d)
66

Description

**Is your feature request related to a problem? Please describe.**
We are using Kepler, but some of our data (the csv of our data) can be more than 500MB, but realistically, we can even expect more than 1 GB of data. This can't be stored in a variable in javascript, especially not as a string (https://developer.mozilla.org/en-US/docs/Web/JavaScript/Reference/Global_Objects/String/length).

**Describe the solution you'd like**
It would be great if we could have a solution added to processors (https://docs.kepler.gl/docs/api-reference/processors/processors#processgeojson:~:text=%3E%20formatted%20fields-,processCsvData,-Process%20csv%20data) to send in blobs, especially for CSV files.

**Describe alternatives you've considered**
We could divide up the data, but that would result in having separate data points for one source, which is not ideal or usable when working with multiple data sources.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.