filecoin-project / filecoin-project/lily

Explore Seralization Formats for Exporting from Lily

Open
#985 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
52
Forks
47
PR merge metrics
No merged PRs in 30d

Description

# Seralizations Formats

Currently lily can export data in the form of SQL transactional statements or CSV. We should explore more alternatives to increase the flexibility of Lily:
- JSON (newline delimited)
- Protobuf (WARNING no deterministic encoding)
- CBOR
- BSON
- Thrift
- Avro
- Parquet
- ...

The aim of this issue is to explore and document the tradeoffs of different encodings and rank them in order of expected utility to Lily and its stakeholders.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.