JanusGraph / JanusGraph/janusgraph-foundationdb

Support for VertexPrograms

Open
#27 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
59
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Background: we used earlier janusgraph+hbase and now we want to move towards foundation db on k8. So we are trying out the janusgraph-foundation db adaptor

During the tests, we figured out that our existing algorithms, similar to the link below
https://github.com/apache/tinkerpop/blob/master/gremlin-core/src/main/java/org/apache/tinkerpop/gremlin/process/computer/ranking/pagerank/PageRankVertexProgram.java

is failing due to the below errors

```
08:47:48 ERROR org.janusgraph.diskstorage.keycolumnvalue.scan.StandardScannerExecutor - Exception trying to setup the job:
org.janusgraph.diskstorage.PermanentBackendException: Permanent failure in storage backend
at com.experoinc.janusgraph.diskstorage.foundationdb.FoundationDBKeyValueStore.getSlice(FoundationDBKeyValueStore.java:137) ~[janusgraph-foundationdb-0.1.0.jar:na]
at org.janusgraph.diskstorage.keycolumnvalue.keyvalue.OrderedKeyValueStoreAdapter.getKeys(OrderedKeyValueStoreAdapter.java:116) ~[janusgraph-core-0.4.1.jar:na]
at org.janusgraph.diskstorage.keycolumnvalue.KCVSUtil.getKeys(KCVSUtil.java:70) ~[janusgraph-core-0.4.1.jar:na]
at org.janusgraph.diskstorage.keycolumnvalue.scan.StandardScannerExecutor.addDataPuller(StandardScannerExecutor.java:92) ~[janusgraph-core-0.4.1.jar:na]
at org.janusgraph.diskstorage.keycolumnvalue.scan.StandardScannerExecutor.run(StandardScannerExecutor.java:121) ~[janusgraph-core-0.4.1.jar:na]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_201]
Caused by: org.janusgraph.diskstorage.PermanentBackendException: Max transaction reset count exceeded
at com.experoinc.janusgraph.diskstorage.foundationdb.FoundationDBTx.getRange(FoundationDBTx.java:188) ~[janusgraph-foundationdb-0.1.0.jar:na]
at com.experoinc.janusgraph.diskstorage.foundationdb.FoundationDBKeyValueStore.getSlice(FoundationDBKeyValueStore.java:129) ~[janusgraph-foundationdb-0.1.0.jar:na]
... 5 common frames omitted
Exception in thread "Thread-4" java.lang.NullPointerException
at org.janusgraph.diskstorage.keycolumnvalue.scan.StandardScannerExecutor.cleanup(StandardScannerExecutor.java:224)
at org.janusgraph.diskstorage.keycolumnvalue.scan.StandardScannerExecutor.cleanupSilent(StandardScannerExecutor.java:235)
at org.janusgraph.diskstorage.keycolumnvalue.scan.StandardScannerExecutor.run(StandardScannerExecutor.java:125)
at java.lang.Thread.run(Thread.java:748)
```

Has anyone faced similar errors before? appreciate your help. thanks.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by comparing the TinkerPop PageRankVertexProgram.java implementation with the FoundationDB adapter path shown in FoundationDBKeyValueStore.getSlice and FoundationDBTx.getRange. Reproduce the scanner failure and trace the Max transaction reset count exceeded error through StandardScannerExecutor. Done is not defined by the issue; investigation would first need to identify the adapter incompatibility and agree on a fix.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend, databases
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.