admin管理员组

文章数量:1558102

Found binding in [jar:file:/home/wk/sd_spark/spark/spark-bodropout-test/spark/jars/slf4j-log4j12-1.7.16.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/wk/sd_hadoop/spark/spark-bodropout-test/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]

jar包冲突,删掉一个

mvn -Phadoopbench -Psparkbench -Dspark=2.2 -Dscala=2.11 clean package

编译hibench,我版本spark2.2 scala 2.11 刚好
hibench出错的原因通常是版本不对,打开spark-shell看版本,对应好,还有就是虚拟内存溢出的问题,在上一篇博客,记得同步集群

连接不到master7077 可以用netstat -an|grep 7077查看端口号,原因是没有开启master,进入spark/sbin/start-all.sh
hdfs web页面打不开关防火墙: systemctl stop firewalld.service

本文标签: 可能出现错误hibench