apache / apache/incubator-graphar

[Feat][Doc] Generate GAR files of whole `ldbc-sample` property graph as an example to demonstrate GAR format

Open
#66 0 comments 0 reactions 0 assignees View on GitHub
Component:Documentation good first issue
Dominant language
C++
Stars
373
Forks
93
Avg merge
7d 21h
Merged PRs (30d)
7

Description

**Is your feature request related to a problem? Please describe.**
Maybe we need a widely-used property graph to demonstrate the GAR file format. The ldbc dataset seems to be a good choice.

This issue can be a `good first issue` for a developer.

**Describe the solution you'd like**
Generate formatted files in GraphAr for a property graph including:
- [ ] design the metadata files (in Yaml) for the ldbc graph, the file format of chunk files can be `csv` for easy to read
- [ ] generate GAR data files with the Spark library
- [ ] add some tests to check the data files are match to the metadata information through utilizing the Info classes

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
related to issue #37

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the ldbc-sample graph and related issue #37, then locate the project’s metadata and Info-class entry points. Define YAML metadata and readable CSV chunks, generate the GAR data with Spark, and add checks that the data matches the metadata; done means the example files and tests are complete.

Written by the indexing model from the issue text.

Assessment

Tech stack
spark
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.