PowerGraph安装问题测试记录

cloudeagle_bupt

浏览: 540169 次

最近访客更多访客>>

morelily

csmnjk

jnh

superich2008

博主相关

博客

微博

相册

留言

关于我

文章分类

全部博客 (2884)

社区版块

存档分类

使用版本为V2.2

https://github.com/dato-code/PowerGraph

问题1:

执行./configure

出现问题: 找不到opencv, 无法从下载地址中抽取。。。。

查看CMakeFileList.txt文件:

解决方法：手动下载operncv 3.4.3, 将其改为:

# OpenCV =================================================================
ExternalProject_Add(opencv
PREFIX ${GraphLab_SOURCE_DIR}/deps/opencv
URL ~/opencv-2.4.9.zip

问题解决

问题2: 继续执行./configure

CMake Error: The following variables are used in this project, but they are set to NOTFOUND.
Please set them or make sure they are set and tested correctly in the CMake files:
JAVA_JVM_LIBRARY (ADVANCED)
linked by target "external_dependencies" in directory /home/liuqiang2/PowerGraph-master
linked by target "arbitrary_signal_test" in directory /home/liuqiang2/PowerGraph-master/tests
linked by target "async_consistent_test" in directory /home/liuqiang2/PowerGraph-master/tests

缺少JAVA_JVM_LIBRARY 变量定义,在总的CMakeList里增加:

set(JAVA_JVM_LIBRARY "~/jdk/jdk1.7.0_11/jre/lib/i386/server/libjvm.so")
message(${JAVA_JVM_LIBRARY})

3.由于PowerGraph太大，进入release/toolkit/graph_anaysitics 执行: make -j2 ,执行至86%时，发现/usr/bin/ld:skipping incompatible ./libjvm.so when searching for -l jvm

发现libjvm.so的位数不对，只有32位，重新下载64,具体见http://blog.csdn.net/cloudeagle_bupt/article/details/49363095

将CMake总文件修改为:

set(JAVA_JVM_LIBRARY "~/jdk/jdk1.7.0_79/jre/lib/amd64/server/libjvm.so")
message(${JAVA_JVM_LIBRARY})

编译100%通过.

其他可能会有些链接问题，做个软链接就行了....

./pagerank 测试单机版能否运行.

吼吼吼,继续运行，安装最新版本mpi

顺利完成，

进入目录:

[liuqiang2@mu02 graph_analytics]$ pwd
/home/liuqiang2/PowerGraph-master/release/toolkits/graph_analytics

[liuqiang2@mu02 graph_analytics]$ mpiexec -f ~/mpi/hosts -n 2 ./pagerank --powerlaw=10000000

mpiexec -f ~/mpi/hosts -n 30 ./pagerank --format=snap --graph=280w_cpl.txt --iterations=30

运行，OK.

如果需要HDFS运行：

首先确保hadoop 的classpath正确:

[liuqiang2@mu02 graph_analytics]$ hadoop classpath

/opt/hadoop-1.2.0/libexec/../conf:/home/liuqiang2/jdk/jdk1.7.0_79/lib/tools.jar:/opt/hadoop-1.2.0/libexec/..:/opt/hadoop-1.2.0/libexec/../hadoop-core-1.2.0.jar:/opt/hadoop-1.2.0/libexec/../lib/asm-3.2.jar:/opt/hadoop-1.2.0/libexec/../lib/aspectjrt-1.6.11.jar:/opt/hadoop-1.2.0/libexec/../lib/aspectjtools-1.6.11.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-beanutils-1.7.0.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-beanutils-core-1.8.0.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-cli-1.2.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-codec-1.4.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-collections-3.2.1.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-configuration-1.6.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-daemon-1.0.1.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-digester-1.8.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-el-1.0.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-httpclient-3.0.1.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-io-2.1.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-lang-2.4.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-logging-1.1.1.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-logging-api-1.0.4.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-math-2.1.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-net-3.1.jar:/opt/hadoop-1.2.0/libexec/../lib/commons-pool-1.5.6.jar:/opt/hadoop-1.2.0/libexec/../lib/core-3.1.1.jar:/opt/hadoop-1.2.0/libexec/../lib/hadoop-capacity-scheduler-1.2.0.jar:/opt/hadoop-1.2.0/libexec/../lib/hadoop-fairscheduler-1.2.0.jar:/opt/hadoop-1.2.0/libexec/../lib/hadoop-thriftfs-1.2.0.jar:/opt/hadoop-1.2.0/libexec/../lib/hama-commons-0.6.4.jar:/opt/hadoop-1.2.0/libexec/../lib/hama-core-0.6.4.jar:/opt/hadoop-1.2.0/libexec/../lib/hsqldb-1.8.0.10.jar:/opt/hadoop-1.2.0/libexec/../lib/jackson-core-asl-1.8.8.jar:/opt/hadoop-1.2.0/libexec/../lib/jackson-mapper-asl-1.8.8.jar:/opt/hadoop-1.2.0/libexec/../lib/jasper-compiler-5.5.12.jar:/opt/hadoop-1.2.0/libexec/../lib/jasper-runtime-5.5.12.jar:/opt/hadoop-1.2.0/libexec/../lib/java_memcached-release_2.6.6.jar:/opt/hadoop-1.2.0/libexec/../lib/jdeb-0.8.jar:/opt/hadoop-1.2.0/libexec/../lib/jersey-core-1.8.jar:/opt/hadoop-1.2.0/libexec/../lib/jersey-json-1.8.jar:/opt/hadoop-1.2.0/libexec/../lib/jersey-server-1.8.jar:/opt/hadoop-1.2.0/libexec/../lib/jets3t-0.6.1.jar:/opt/hadoop-1.2.0/libexec/../lib/jetty-6.1.26.jar:/opt/hadoop-1.2.0/libexec/../lib/jetty-util-6.1.26.jar:/opt/hadoop-1.2.0/libexec/../lib/jsch-0.1.42.jar:/opt/hadoop-1.2.0/libexec/../lib/junit-4.5.jar:/opt/hadoop-1.2.0/libexec/../lib/kfs-0.2.2.jar:/opt/hadoop-1.2.0/libexec/../lib/log4j-1.2.15.jar:/opt/hadoop-1.2.0/libexec/../lib/mockito-all-1.8.5.jar:/opt/hadoop-1.2.0/libexec/../lib/mongo-2.10.1.jar:/opt/hadoop-1.2.0/libexec/../lib/oro-2.0.8.jar:/opt/hadoop-1.2.0/libexec/../lib/servlet-api-2.5-20081211.jar:/opt/hadoop-1.2.0/libexec/../lib/slf4j-api-1.4.3.jar:/opt/hadoop-1.2.0/libexec/../lib/slf4j-api-1.6.1.jar:/opt/hadoop-1.2.0/libexec/../lib/slf4j-log4j12-1.4.3.jar:/opt/hadoop-1.2.0/libexec/../lib/slf4j-simple-1.6.1.jar:/opt/hadoop-1.2.0/libexec/../lib/xmlenc-0.52.jar:/opt/hadoop-1.2.0/libexec/../lib/jsp-2.1/jsp-2.1.jar:/opt/hadoop-1.2.0/libexec/../lib/jsp-2.1/jsp-api-2.1.jar

[liuqiang2@mu02 graph_analytics]$ mpiexec -f ~/mpi/hosts -env CLASSPATH=`hadoop classpath` -n 30 ./pagerank --format=snap --graph=hdfs://mu02:9000/test/280w_cpl.txt --iterations=30

分享到：