apache / apache/incubator-graphar
[Feat][Doc] Generate GAR files of whole `ldbc-sample` property graph as an example to demonstrate GAR format
- Dominant language
- C++
- Stars
- 373
- Forks
- 93
- Avg merge
- 7d 21h
- Merged PRs (30d)
- 7
Description
**Is your feature request related to a problem? Please describe.**
Maybe we need a widely-used property graph to demonstrate the GAR file format. The ldbc dataset seems to be a good choice.
This issue can be a `good first issue` for a developer.
**Describe the solution you'd like**
Generate formatted files in GraphAr for a property graph including:
- [ ] design the metadata files (in Yaml) for the ldbc graph, the file format of chunk files can be `csv` for easy to read
- [ ] generate GAR data files with the Spark library
- [ ] add some tests to check the data files are match to the metadata information through utilizing the Info classes
**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.
**Additional context**
related to issue #37
Contributor guide
Research direction
Start by reviewing the ldbc-sample graph and related issue #37, then locate the project’s metadata and Info-class entry points. Define YAML metadata and readable CSV chunks, generate the GAR data with Spark, and add checks that the data matches the metadata; done means the example files and tests are complete.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- spark
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100