alibaba / alibaba/graphlearn-for-pytorch

Support load whole FragmentGroup from multiple vineyard instance

Open
#140 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
146
Forks
48
PR merge metrics
No merged PRs in 30d

Description

### 🚀 The feature, motivation and pitch

Currently, vineyard_to_csr in vineyard_utils.py only read Fragment in current vineyard instance. We need a solution to get whole FragmentGroup from vineyard., by using vineyard RPC client.

### Alternatives

_No response_

### Additional context

_No response_

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in vineyard_utils.py at vineyard_to_csr and trace how it currently reads Fragment data from the current vineyard instance. Investigate the vineyard RPC client path for accessing multiple instances, then verify that the complete FragmentGroup can be loaded across them.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.