alibaba / alibaba/euler

Euler2 RGCN speed

Open
#282 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.9k
Forks
553
PR merge metrics
No merged PRs in 30d

Description

Hi,
I am using the RGCN implementation from examples directory on a custom dataset with 1137061 nodes and 58336927 edges. I have 6 node types and 67 edge types. There are no node features and 1 edge feature(which is equal to the edge type). The issue I am facing is that the training is extremely slow.
The training was done on an n1-standard-64 machine of Google Cloud Platform (see here : https://cloud.google.com/compute/docs/machine-types) [64 cores, 240GB mem]
I used the following parameters :
`layers = 1
num_negs = 2
lr = 0.01
optimizer = adam
hidden_dim = 4
num_epochs = 1
embedding_dim 4
batch_size 1024`
The training took total 183m51.489s. I have used very low settings here, and want to use higher settings like more dimensions, more number of epochs etc, but training time is an issue.
Is such large training time expected for such kind of dataset? Or something is going wrong here?
My training logs can be seen here => https://drive.google.com/file/d/1DyEPa9abK3X0UCiOqsemWZ8yxP5GjXBl/view?usp=sharing

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the RGCN implementation in the examples directory and inspect the linked training logs alongside the stated dataset, batch, and epoch settings. Reproduce or profile the one-epoch run if the environment is available; done means determining whether the runtime is expected or identifying a documented, actionable bottleneck.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, gcp, machine-learning
Domain
cloud, distributed-systems, machine-learning, performance
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.