Giraph集群测试Pagerank

[liuqiang2@mu02 bin]$  giraph ../giraph-core-1.1.0.jar  org.apache.giraph.benchmark.PageRankComputation -vif  org.apache.giraph.io.formats.IntFloatNullTextInputFormat -vip /test/youTube.txt  -vof org.apache.giraph.io.formats.IdWithValueTextOutputFormat -op /output  -w 15

16/03/18 17:32:05 INFO utils.ConfigurationUtils: No edge input format specified. Ensure your InputFormat does not require one.
16/03/18 17:32:05 INFO utils.ConfigurationUtils: No edge output format specified. Ensure your OutputFormat does not require one.
16/03/18 17:32:05 INFO job.GiraphJob: run: Since checkpointing is disabled (default), do not allow any task retries (setting mapred.map.max.attempts = 0, old value = 4)
16/03/18 17:32:13 INFO job.GiraphJob: Tracking URL: http://mu02:50030/jobdetails.jsp?jobid=job_201603181726_0002
16/03/18 17:32:13 INFO job.GiraphJob: Waiting for resources... Job will start only when it gets all 16 mappers
16/03/18 17:33:28 INFO job.HaltApplicationUtils$DefaultHaltInstructionsWriter: writeHaltInstructions: To halt after next superstep execute: 'bin/halt-application --zkServer c02b10:22181 --zkNode /_hadoopBsp/job_201603181726_0002/_haltComputation'
16/03/18 17:33:28 INFO mapred.JobClient: Running job: job_201603181726_0002
16/03/18 17:33:29 INFO mapred.JobClient: map 100% reduce 0%
16/03/18 17:33:36 INFO mapred.JobClient: Job complete: job_201603181726_0002
16/03/18 17:33:36 INFO mapred.JobClient: Counters: 68
16/03/18 17:33:36 INFO mapred.JobClient:  Zookeeper halt node
16/03/18 17:33:36 INFO mapred.JobClient:   /_hadoopBsp/job_201603181726_0002/_haltComputation=0
16/03/18 17:33:36 INFO mapred.JobClient:  Zookeeper base path
16/03/18 17:33:36 INFO mapred.JobClient:   /_hadoopBsp/job_201603181726_0002=0
16/03/18 17:33:36 INFO mapred.JobClient:  Job Counters
16/03/18 17:33:36 INFO mapred.JobClient:   SLOTS_MILLIS_MAPS=770552
16/03/18 17:33:36 INFO mapred.JobClient:   Total time spent by all reduces waiting after reserving slots (ms)=0
16/03/18 17:33:36 INFO mapred.JobClient:   Total time spent by all maps waiting after reserving slots (ms)=0
16/03/18 17:33:36 INFO mapred.JobClient:   Launched map tasks=16
16/03/18 17:33:36 INFO mapred.JobClient:   SLOTS_MILLIS_REDUCES=0
16/03/18 17:33:36 INFO mapred.JobClient:  Giraph Timers
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 27 PageRankComputation (ms)=1929
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 3 PageRankComputation (ms)=1732
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 1 PageRankComputation (ms)=445
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 11 PageRankComputation (ms)=210
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 23 PageRankComputation (ms)=167
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 20 PageRankComputation (ms)=2012
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 8 PageRankComputation (ms)=941
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 13 PageRankComputation (ms)=1936
16/03/18 17:33:36 INFO mapred.JobClient:   Shutdown (ms)=9213
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 2 PageRankComputation (ms)=344
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 25 PageRankComputation (ms)=2403
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 29 PageRankComputation (ms)=180
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 12 PageRankComputation (ms)=1639
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 15 PageRankComputation (ms)=1637
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 26 PageRankComputation (ms)=1597
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 18 PageRankComputation (ms)=172
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 9 PageRankComputation (ms)=1662
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 10 PageRankComputation (ms)=245
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 14 PageRankComputation (ms)=186
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 0 PageRankComputation (ms)=473
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 24 PageRankComputation (ms)=1628
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 16 PageRankComputation (ms)=1659
16/03/18 17:33:36 INFO mapred.JobClient:   Input superstep (ms)=3219
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 4 PageRankComputation (ms)=235
16/03/18 17:33:36 INFO mapred.JobClient:   Initialize (ms)=13423
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 21 PageRankComputation (ms)=171
16/03/18 17:33:36 INFO mapred.JobClient:   Setup (ms)=146
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 5 PageRankComputation (ms)=1717
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 30 PageRankComputation (ms)=132
16/03/18 17:33:36 INFO mapred.JobClient:   Total (ms)=42824
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 7 PageRankComputation (ms)=219
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 28 PageRankComputation (ms)=1664
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 17 PageRankComputation (ms)=155
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 22 PageRankComputation (ms)=1617
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 19 PageRankComputation (ms)=874
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep 6 PageRankComputation (ms)=256
16/03/18 17:33:36 INFO mapred.JobClient:  Zookeeper server:port
16/03/18 17:33:36 INFO mapred.JobClient:   c02b10:22181=0
16/03/18 17:33:36 INFO mapred.JobClient:  Giraph Stats
16/03/18 17:33:36 INFO mapred.JobClient:   Aggregate edges=2987624
16/03/18 17:33:36 INFO mapred.JobClient:   Sent message bytes=0
16/03/18 17:33:36 INFO mapred.JobClient:   Superstep=31
16/03/18 17:33:36 INFO mapred.JobClient:   Last checkpointed superstep=0
16/03/18 17:33:36 INFO mapred.JobClient:   Current workers=15
16/03/18 17:33:36 INFO mapred.JobClient:   Aggregate sent messages=89628720
16/03/18 17:33:36 INFO mapred.JobClient:   Current master task partition=0
16/03/18 17:33:36 INFO mapred.JobClient:   Sent messages=0
16/03/18 17:33:36 INFO mapred.JobClient:   Aggregate finished vertices=1134890
16/03/18 17:33:36 INFO mapred.JobClient:   Aggregate sent message message bytes=718049010
16/03/18 17:33:36 INFO mapred.JobClient:   Aggregate vertices=1134890
16/03/18 17:33:36 INFO mapred.JobClient:  File Output Format Counters
16/03/18 17:33:36 INFO mapred.JobClient:   Bytes Written=0
16/03/18 17:33:36 INFO mapred.JobClient:  FileSystemCounters
16/03/18 17:33:36 INFO mapred.JobClient:   HDFS_BYTES_READ=29585033
16/03/18 17:33:36 INFO mapred.JobClient:   FILE_BYTES_WRITTEN=2103073
16/03/18 17:33:36 INFO mapred.JobClient:   HDFS_BYTES_WRITTEN=22520835
16/03/18 17:33:36 INFO mapred.JobClient:  File Input Format Counters
16/03/18 17:33:36 INFO mapred.JobClient:   Bytes Read=0
16/03/18 17:33:36 INFO mapred.JobClient:  Map-Reduce Framework
16/03/18 17:33:36 INFO mapred.JobClient:   Map input records=16
16/03/18 17:33:36 INFO mapred.JobClient:   Physical memory (bytes) snapshot=4153704448
16/03/18 17:33:36 INFO mapred.JobClient:   Spilled Records=0
16/03/18 17:33:36 INFO mapred.JobClient:   CPU time spent (ms)=316270
16/03/18 17:33:36 INFO mapred.JobClient:   Total committed heap usage (bytes)=2950692864
16/03/18 17:33:36 INFO mapred.JobClient:   Virtual memory (bytes) snapshot=13605724160
16/03/18 17:33:36 INFO mapred.JobClient:   Map output records=0
16/03/18 17:33:36 INFO mapred.JobClient:   SPLIT_RAW_BYTES=704