alibaba / alibaba/euler

分布式训练无法初始化JVM

Open
#215 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
2.9k
Forks
553
PR merge metrics
No merged PRs in 30d

Description

在试验分布式node2vec的过程中,如下图所示显示Unable to load ZIP library: /usr/libzip.so。看了下这个文件位于在JAVA_HOME子路径下,不在/usr目录下。但是不知道为什么程序会来查找这个目录,是环境变量配置的问题么。查看了JAVA_HOME=/usr/local/jdk1.8.0_131 以及LD_LIBRARY_PATH=/usr/local/jdk1.8.0_131/jre/lib/amd64:/usr/lib64均已设置。物理机环境为redhat,hadoop版本为cdh版本。还有之前编译的时候需要提供libhdfs.so和libjvm.so文件,提示要在/usr/lib64目录下,这个目录又是根据什么决定的?
谢谢~

![图片1](https://user-images.githubusercontent.com/26162190/71508435-ba256200-28c2-11ea-8b73-a2decf7790d2.png)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the distributed node2vec JVM initialization failure in the reported Red Hat/CDH environment, then inspect how JAVA_HOME and LD_LIBRARY_PATH are used to locate libhdfs.so, libjvm.so, and libzip.so. Done means the initialization succeeds with the documented library locations, or the unresolved lookup rule is identified and clearly documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, hadoop, java
Domain
distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.