admin管理员组文章数量:1531657
2024年1月13日发(作者:)
很多刚入门的同学找不到版本对应关系,这里从官网整理下来,供大家参考hadoop、hbase、hive版本对应关系问题导读:网上很多同学都找不到hbase、hive、hadoop的对应关系,这里整理一下2.X与hbase、哪些版本对应?2.X与hive哪些版本对应?hadoop、hbase、hive版本对应关系查找表hadoop与hive版本对应关系hive版本0.13.1支持hadoop版本Hadoop 0.20.x, , 1.x.y, 版本0.13.0支持hadoop版本Hadoop 0.20.x, , 1.x.y, 版本0.12.0支持hadoop版本Hadoop 0.20.x, , 1.x.y, 版本0.11.0支持hadoop版本Hadoop 0.20.x, , 1.x.y, 版本0.10.0支持hadoop版本Hadoop 0.20.x, , 1.x.y, p1.2+hbase0.95.0+hive0.11.0
会产生hbase+hive的不兼容,创建hive+hbase的关联表就会报pair对异常。hadoop1.2+hbase0.94.9+hive0.10.0 没问题,解决了上个版本的不兼容问题。
hadoop-1.0.3+hive-0.9.0+hbase-0.92.0兼容hadoop2.2+hbase0.96+hive0.12兼容(有些小问题,可能需要一些补丁)hadoop2.2+hbase0.96+hive0.13兼容(应该兼容)Hadoop 与hbase支持版本S = 支持并且测试,X = 不支持,NT = 应该可以,但是没有测试.-0.98.x[a]p-1.0.0-1.0.2[c]Hadoop-1.0.3+TXXXXXXXXXXSSSNTNTNT [d]NTNTNTXXXSSNTXSSSSSXXXXXXXXSSSSXXXXXXXXNTNTSS[a] Support for Hadoop 1.x is 1.x is NOT supported[c] HBase requires hadoop 1.0.3 at a minimum; there is an issue where we
cannot find KerberosUtil compiling against earlier versions of Hadoop.[d] To get 0.94.x to run on hadoop 2.2.0, you need to change the hadoop 2
and protobuf versions in the : Here is a diff with changes:1.$ svn diff
: 3.===================================================================4.--- (revision 1545157)5.+++ (working copy)6.@@ -1034,7 +1034,7 @@7.
has been installed:Go to the hbase root folder, using the command line;Type the following commands:$ protoc -Isrc/main/protobuf --java_out=src/main/java
src/main/protobuf/$ protoc -Isrc/main/protobuf --java_out=src/main/java
src/main/protobuf/uilding against the hadoop 2 profile by running something like the following
command:$ mvn clean install assembly:single -e=2.0 -DskipTests
lace the Hadoop Bundled With HBase!Because HBase depends on Hadoop,
it bundles an instance of the Hadoop jar under its lib directory. The bundled
jar is ONLY for use in standalone mode. In distributed mode, it is critical that
the version of Hadoop that is out on your cluster match what is under HBase.
Replace the hadoop jar found in the HBase lib directory with the hadoop jar
you are running on your cluster to avoid version mismatch issues. Make sure
you replace the jar in HBase everywhere on your cluster. Hadoop version
mismatch issues have various manifestations but often all looks like its hung
up.由于管网随时更新,这里附上管网:/book/#hadoop本文链接:/对于云技术、大数据爱好者、可以关注:about云腾讯认证空间,每天更新最新内容,经典文章/278595437/mainabout云官方群39327136、371358502、322273151云计算爱好者群惯用手机可以关注微信:云资源、云技术、疑问解答邮件订阅地址:/cgi-bin/qf_invite?id=5e272bf95516e801681caf0fda5304dcadda1f67b4bbe4d8淘宝云技术入门、hadoop、openstack及其它视频:
p:///?v=1
版权声明:本文标题:hadoop、hbase、hive版本对应关系查找表 - 文档 内容由热心网友自发贡献,该文观点仅代表作者本人, 转载请联系作者并注明出处:https://m.elefans.com/xitong/1705083095a122289.html, 本站仅提供信息存储空间服务,不拥有所有权,不承担相关法律责任。如发现本站有涉嫌抄袭侵权/违法违规的内容,一经查实,本站将立刻删除。
发表评论