`
cloudeagle_bupt
  • 浏览: 538391 次
文章分类
社区版块
存档分类
最新评论

hadoop-1.0.3 mrbenchc测试用例

 
阅读更多

hadoop jar hadoop-test-1.0.3.jar mrbench -inputLines 500 -maps 8 -reduces 50

注意, inputLines 选项默认为1, 如果不设的话,会导致输入数据过小,则后面无论你maps参数设置多少,在作业初始化时InputFormat的getSplits函数会根据maps参数的数据计算平均每块的数据大小,若数据过小则总的splits数目,即maps数目则设置为默认值2, 查了1个小时才查明白怎么回事。。。。

他妹的...

PS: 此外,在修改JobClietn代码后,log4j里增加了一句:log4j.logger.org.apache.hadoop.mapred.JobClient=DEBUG, 然后发现其Log输出都在console上面不知道是咋回事。

分享到:
评论

相关推荐

    hadoop-core-1.0.3.jar

    Exception in thread "main" java.io.IOException: Failed to ...解决方法是,修改/hadoop-1.0.3/src/core/org/apache/hadoop/fs/FileUtil.java文件 688-692行注释,然后重新编译源代码,重新打一个hadoop.jar的包。

    hadoop-eclipse-plugin-1.0.3.jar

    windows下hadoop 的 eclipse 插件,eclipse3.7版本测试通过,lib里面包含解决windows下连接linux权限问题的hadoop-core.jar文件。

    hadoop-1.0.3-API.chm

    Hadoop-1.0.3 API, 帮助用户查看Hadoop自身提供的接口调用

    hadoop-1.0.3 中文.chm

    hadoop-1.0.3 中文,资料都是来自apache,资料还是很齐全的,自己编译的,可以搜索,有些显示还是0.18版的,可能是文档没有更新过来。分数有点多,回复就会还你的。

    hadoop-1.0.3-eclipse-plugin.jar

    hadoop-1.0.3-eclipse-plugin.jar 插件 你懂的!

    hadoop-1.0.3 eclipse插件

    hadoop-1.0.3 eclipse插件

    flink-1.0.3-bin-hadoop27-scala_2

    flink-1.0.3-bin-hadoop27-scala_2flink-1.0.3-bin-hadoop27-scala_2

    hadoop-eclipse-plugin-1.0.3.jar 插件

    hadoop-eclipse-plugin-1.0.3.jar 插件。 hadoop eclipse 插件,用于在eclipse中搭建hadoop的开发环境。 hadoop eclipse插件

    hadoop-mapreduce-client-jobclient-2.6.5-API文档-中文版.zip

    赠送jar包:hadoop-mapreduce-client-jobclient-2.6.5.jar; 赠送原API文档:hadoop-mapreduce-client-jobclient-2.6.5-javadoc.jar; 赠送源代码:hadoop-mapreduce-client-jobclient-2.6.5-sources.jar; 赠送...

    hadoop-yarn-client-2.6.5-API文档-中文版.zip

    赠送jar包:hadoop-yarn-client-2.6.5.jar; 赠送原API文档:hadoop-yarn-client-2.6.5-javadoc.jar; 赠送源代码:hadoop-yarn-client-2.6.5-sources.jar; 赠送Maven依赖信息文件:hadoop-yarn-client-2.6.5.pom;...

    hadoop最新版本3.1.1全量jar包

    hadoop-annotations-3.1.1.jar hadoop-common-3.1.1.jar hadoop-mapreduce-client-core-3.1.1.jar hadoop-yarn-api-3.1.1.jar hadoop-auth-3.1.1.jar hadoop-hdfs-3.1.1.jar hadoop-mapreduce-client-hs-3.1.1.jar ...

    hadoop-yarn-common-2.6.5-API文档-中文版.zip

    赠送jar包:hadoop-yarn-common-2.6.5.jar 赠送原API文档:hadoop-yarn-common-2.6.5-javadoc.jar 赠送源代码:hadoop-yarn-common-2.6.5-sources.jar 包含翻译后的API文档:hadoop-yarn-common-2.6.5-javadoc-...

    hadoop-eclipse-plugin-2.7.3和2.7.7

    hadoop-eclipse-plugin-2.7.3和2.7.7的jar包 hadoop-eclipse-plugin-2.7.3和2.7.7的jar包 hadoop-eclipse-plugin-2.7.3和2.7.7的jar包 hadoop-eclipse-plugin-2.7.3和2.7.7的jar包

    hadoop-eclipse-plugin三个版本的插件都在这里了。

    hadoop-eclipse-plugin-2.7.4.jar和hadoop-eclipse-plugin-2.7.3.jar还有hadoop-eclipse-plugin-2.6.0.jar的插件都在这打包了,都可以用。

    好用hadoop-eclipse-plugin-1.2.1

    hadoop-eclipse-plugin-1.2.1hadoop-eclipse-plugin-1.2.1hadoop-eclipse-plugin-1.2.1hadoop-eclipse-plugin-1.2.1

    hadoop-eclipse-plugin-1.2.1.jar有用的

    该资源包里面包含eclipse上的hadoop-1.2.1版本插件的jar包和hadoop-1.2.1.tar.gz,亲测可用~~请在下载完该包后解压,将hadoop-1.2.1放置于Eclipse\plugins目录下,然后重启eclipse,将hadoop-1.2.1.tar.gz放到D:\...

    hadoop-common-2.7.3-API文档-中文版.zip

    赠送jar包:hadoop-common-2.7.3.jar; 赠送原API文档:hadoop-common-2.7.3-javadoc.jar; 赠送源代码:hadoop-common-2.7.3-sources.jar; 赠送Maven依赖信息文件:hadoop-common-2.7.3.pom; 包含翻译后的API文档...

Global site tag (gtag.js) - Google Analytics