DataShape serialization
- Dominant language
- Python
- Stars
- 189
- Forks
- 62
- PR merge metrics
- No merged PRs in 30d
Description
Quoting from blaze/blaze#1361:
> I feel like the string representation of the dshape is the best serialization format. Maybe what we need is a javascript implementation of the datashape parser.
That would be one direction to go in here; when I floated it with our Client-side JS team, there was resistance to having to develop and maintain another parser.
Since datashape objects are intrinsically nested, my desire would be to serialize datashapes in a way that's consistent with that nesting, to remove the need to implement multiple datashape parsers and keep them in sync, etc. The string form of datashapes are great for human consumption, but they're intrinsically flat, and we run into issues with conflating representation with serialization.
My vote is for a serialization format that encodes the nesting, so that we can do datashape parsing in one and only one place. The `DataShape.__str__` implementation can handle the human-readable part of the problem.
@llllllllll thoughts?
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the DataShape.__str__ implementation and the referenced blaze/blaze#1361 discussion, then review how the datashape parser is expected to serve the client-side JavaScript team. Done requires an agreed nested serialization format that separates machine serialization from the human-readable string form.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript, python
- Domain
- data
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100