alibaba / alibaba/euler

json数据通过spark生成问题

Open
#93 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.9k
Forks
553
PR merge metrics
No merged PRs in 30d

Description

感谢这么好的训练框架,但是大规模数据要生成框架要求的格式非常困难,是否有配套的spark脚本可以从点表和边表生成json结果。

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue does not name any files, tests, or entry points. Start by locating the framework’s expected JSON schema and the existing graph data-loading path, then determine how Spark should convert vertex and edge tables; done means a documented, runnable script produces valid framework-format JSON from both inputs.

Written by the indexing model from the issue text.

Assessment

Tech stack
spark
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.