anvaka / anvaka/ngraph.graph

Merging multiple graphs?

Open
#38 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
580
Forks
72
PR merge metrics
No merged PRs in 30d

Description

Hi.
Thanks for this awesome library! I was able to visualize some pretty big datasets (5-10 millions of nodes and 15 millions of links).

So I tried to increase the number of nodes(somewhere around 50 millions).
I have 32GB of RAM btw.

My current issue is that creating a ngraph.graph instance is a bit difficult. I mean because of such a large dataset my PC memory gets full very fast.

So I was wondering if there is a way to save several ngraph.graph instances into files and then merge them (so the result next can be processed with ngraph.tobinary).
Or maybe there is another approach to this issue?

Thanks!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing how ngraph.graph instances are created and how ngraph.tobinary handles graph data. Determine whether merging serialized graph instances is a defined, feasible change; done would require a confirmed approach for processing the stated large datasets and clear documentation of its limits.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.