apache / apache/incubator-graphar

[Feat] GraphAr Spark library to support adding new rows/columns

Open
#31 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C++
Stars
373
Forks
93
Avg merge
7d 21h
Merged PRs (30d)
7

Description

**Is your feature request related to a problem? Please describe.**
In real use cases, the graph data is usually continuously changing, including adding, deleting, and modifying vertices or edges. As part of incremental management functions, we intend to extend the GraphAr Spark tools to support adding new rows/columns conveniently and efficiently.

**Describe the solution you'd like**
Support to add new rows/columns for vertex/edge table and dump the new data by generating new GAR files or appending/rewriting existing GAR files.

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named. Start by locating the GraphAr Spark tools and the vertex/edge table GAR read and write paths. Define the behavior for adding rows and columns, including when to generate, append, or rewrite GAR files, and verify the resulting data for both vertex and edge tables.

Written by the indexing model from the issue text.

Assessment

Tech stack
spark
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.