执行报错

执行报错

执行这个RestAPI请求,可以顺利提交上去了,但是执行报错,网上查了下,说是可能配置有问题,但是这里的配置好多啊,眼多看花了,老师,这种错误应该怎么排查呢?

Error: Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster


具体错误日志:

WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exception from container-launch with container ID: container_1703965001055_0009_01_000001 and exit code: 1

ExitCodeException exitCode=1: 

at org.apache.hadoop.util.Shell.runCommand(Shell.java:1068)

at org.apache.hadoop.util.Shell.run(Shell.java:957)

at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1282)

at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:309)

at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:585)

at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:373)

at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:103)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:748)

2024-01-05 20:50:02,122 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exception from container-launch.

2024-01-05 20:50:02,122 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Container id: container_1703965001055_0009_01_000001

2024-01-05 20:50:02,122 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exit code: 1

2024-01-05 20:50:02,123 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container launch failed : Container exited with a non-zero exit code 1. 

2024-01-05 20:50:02,148 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1703965001055_0009_01_000001 transitioned from RUNNING to EXITED_WITH_FAILURE

2024-01-05 20:50:02,152 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerCleanup: Cleaning up container container_1703965001055_0009_01_000001


https://img1.sycdn.imooc.com/climg/6597f7a7099b963212670573.jpg

https://img1.sycdn.imooc.com/climg/6597f7b10993c37110410282.jpg

正在回答 回答被采纳积分+1

登陆购买课程后可参与讨论,去登陆

1回答
徐老师 2024-01-06 12:15:31

这种问题就不好排查了,网上的资料也比较少。

你现在用的各种软件版本和课程中的也不一样,所以会遇到一些课程中没有遇到的问题。

  • 我查了一下,从目前的错误信息中也没有查到有用的信息
    2024-01-06 12:47:03
  • 提问者 蒋昌魁 回复 徐老师 #2

    嗯嗯,好的,谢谢老师,我大概查了些是hadoop3还需要一些额外配置,不过目前还不够熟悉,等项目接触多了,以后再回过头来试试能不能解决这类问题

    2024-01-06 13:36:30
问题已解决,确定采纳
还有疑问,暂不采纳

恭喜解决一个难题,获得1积分~

来为老师/同学的回答评分吧

0 星
请稍等 ...
意见反馈 帮助中心 APP下载
官方微信

在线咨询

领取优惠

免费试听

领取大纲

扫描二维码,添加
你的专属老师