1、报错 ERROR TaskSchedulerImpl: Lost executor 3 on 172.16.0.24: Unable to create executor due to Unable to register with external shuffle server due to : Failed to connect to /172.16.0.24:7337
在spark-defaults.conf文件中添加:
spark.shuffle.service.enabled true
2、spark-submit后运行程序连接不上子节点
java.net.ConnectException: Connectionrefused
INFOzookeeper.ClientCnxn: Opening socket connection to serverlocalhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknownerror)
估计是用到了Hbase:
将Hbase目录中conf下hbase-site.xml拷贝到spark的conf目录下