JanusGraph / JanusGraph/janusgraph

JanusGraph OLAP on vanilla Spark cluster

Open
#959 0 comments 0 reactions 0 assignees View on GitHub
area/spark
Dominant language
Java
Stars
5.8k
Forks
1.2k
Avg merge
13h 53m
Merged PRs (30d)
6

Description

TinkerPop has a bin/hadoop/init-tp-spark.sh to distribute library jars across the nodes of a vanilla Spark cluster. This script does not work for JanusGraph and a similar script adapted to JanusGraph + documentation would help certain users.

This issue was created as as result of [this thread](https://groups.google.com/forum/#!topic/janusgraph-users/ICREKjSUw8M) on the JanusGraph users forum.

Contributor guide

Open the contributing guide

Research direction

Start by comparing TinkerPop's bin/hadoop/init-tp-spark.sh with how JanusGraph libraries are distributed across a vanilla Spark cluster. Review the linked JanusGraph users forum thread for the compatibility requirements. Done means a JanusGraph-adapted script works for the described cluster setup and accompanying documentation explains its use.

Written by the indexing model from the issue text.

Assessment

Tech stack
hadoop, java, spark
Domain
distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.