asmaloney / asmaloney/libE57Format

Writing and Reading Sections of .e57 File

Open
#244 6 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C++
Stars
191
Forks
82
Avg merge
7h 21m
Merged PRs (30d)
1

Description

Hello,
Currently I only know how to read and write e57 files while storing the data for an entire file in a buffer. Since I have some large .e57's I would like to work with, I was wondering if it was possible to:
Read from 0-5 million points, write 5 million points, then read from 5-10 million points etc. not so much memory is being used.
Looking at the docs I saw CompressedVectorReader.seek(), but I was not able to get this working for me. I have also not been able to find any example in the tests. If you anyone could outline a way for this to be done I would greatly appreciate it.

Contributor guide

Open the contributing guide

Research direction

Start with the CompressedVectorReader.seek() documentation and inspect the existing tests for E57 reading and writing; the issue notes that no seek example is currently available there. Determine how chunked reads and writes could avoid buffering the entire file, and consider the work complete when large files can be processed in point ranges with an accompanying usage example or test.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.