admin管理员组

文章数量:1531657

2024年1月13日发(作者:)

很多刚入门的同学找不到版本对应关系,这里从官网整理下来,供大家参考hadoop、hbase、hive版本对应关系问题导读:网上很多同学都找不到hbase、hive、hadoop的对应关系,这里整理一下2.X与hbase、哪些版本对应?2.X与hive哪些版本对应?hadoop、hbase、hive版本对应关系查找表hadoop与hive版本对应关系hive版本0.13.1支持hadoop版本Hadoop 0.20.x, , 1.x.y, 版本0.13.0支持hadoop版本Hadoop 0.20.x, , 1.x.y, 版本0.12.0支持hadoop版本Hadoop 0.20.x, , 1.x.y, 版本0.11.0支持hadoop版本Hadoop 0.20.x, , 1.x.y, 版本0.10.0支持hadoop版本Hadoop 0.20.x, , 1.x.y, p1.2+hbase0.95.0+hive0.11.0

会产生hbase+hive的不兼容,创建hive+hbase的关联表就会报pair对异常。hadoop1.2+hbase0.94.9+hive0.10.0 没问题,解决了上个版本的不兼容问题。

hadoop-1.0.3+hive-0.9.0+hbase-0.92.0兼容hadoop2.2+hbase0.96+hive0.12兼容(有些小问题,可能需要一些补丁)hadoop2.2+hbase0.96+hive0.13兼容(应该兼容)Hadoop 与hbase支持版本S = 支持并且测试,X = 不支持,NT = 应该可以,但是没有测试.-0.98.x[a]p-1.0.0-1.0.2[c]Hadoop-1.0.3+TXXXXXXXXXXSSSNTNTNT [d]NTNTNTXXXSSNTXSSSSSXXXXXXXXSSSSXXXXXXXXNTNTSS[a] Support for Hadoop 1.x is 1.x is NOT supported[c] HBase requires hadoop 1.0.3 at a minimum; there is an issue where we

cannot find KerberosUtil compiling against earlier versions of Hadoop.[d] To get 0.94.x to run on hadoop 2.2.0, you need to change the hadoop 2

and protobuf versions in the : Here is a diff with changes:1.$ svn diff

: 3.===================================================================4.--- (revision 1545157)5.+++ (working copy)6.@@ -1034,7 +1034,7 @@7. 1.4.38. 1.2.169. 1.8.510.- 2.4.0a11.+ 2.5.012. 1.0.113. 0.8.014. 3.4.515.@@ -2241,7 +2241,7 @@16. 17. 18. 19.- 2.0.0-alpha20.+ 2.2.021. 1.6.122. 23. The next step is to regenerate Protobuf files and assuming that the Protobuf

has been installed:Go to the hbase root folder, using the command line;Type the following commands:$ protoc -Isrc/main/protobuf --java_out=src/main/java

src/main/protobuf/$ protoc -Isrc/main/protobuf --java_out=src/main/java

src/main/protobuf/uilding against the hadoop 2 profile by running something like the following

command:$ mvn clean install assembly:single -e=2.0 -DskipTests

lace the Hadoop Bundled With HBase!Because HBase depends on Hadoop,

it bundles an instance of the Hadoop jar under its lib directory. The bundled

jar is ONLY for use in standalone mode. In distributed mode, it is critical that

the version of Hadoop that is out on your cluster match what is under HBase.

Replace the hadoop jar found in the HBase lib directory with the hadoop jar

you are running on your cluster to avoid version mismatch issues. Make sure

you replace the jar in HBase everywhere on your cluster. Hadoop version

mismatch issues have various manifestations but often all looks like its hung

up.由于管网随时更新,这里附上管网:/book/#hadoop本文链接:/对于云技术、大数据爱好者、可以关注:about云腾讯认证空间,每天更新最新内容,经典文章/278595437/mainabout云官方群39327136、371358502、322273151云计算爱好者群惯用手机可以关注微信:云资源、云技术、疑问解答邮件订阅地址:/cgi-bin/qf_invite?id=5e272bf95516e801681caf0fda5304dcadda1f67b4bbe4d8淘宝云技术入门、hadoop、openstack及其它视频:

p:///?v=1

本文标签: 版本对应关系兼容技术