执行报错
执行这个RestAPI请求,可以顺利提交上去了,但是执行报错,网上查了下,说是可能配置有问题,但是这里的配置好多啊,眼多看花了,老师,这种错误应该怎么排查呢?
Error: Could not find or load main class org.apache.spark.deploy.yarn.ApplicationMaster
具体错误日志:
WARN org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor: Exception from container-launch with container ID: container_1703965001055_0009_01_000001 and exit code: 1
ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:1068)
at org.apache.hadoop.util.Shell.run(Shell.java:957)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1282)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:309)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:585)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:373)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:103)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2024-01-05 20:50:02,122 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exception from container-launch.
2024-01-05 20:50:02,122 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Container id: container_1703965001055_0009_01_000001
2024-01-05 20:50:02,122 INFO org.apache.hadoop.yarn.server.nodemanager.ContainerExecutor: Exit code: 1
2024-01-05 20:50:02,123 WARN org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch: Container launch failed : Container exited with a non-zero exit code 1.
2024-01-05 20:50:02,148 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.container.ContainerImpl: Container container_1703965001055_0009_01_000001 transitioned from RUNNING to EXITED_WITH_FAILURE
2024-01-05 20:50:02,152 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerCleanup: Cleaning up container container_1703965001055_0009_01_000001
正在回答 回答被采纳积分+1
- 参与学习 1151 人
- 提交作业 5960 份
- 解答问题 1144 个
不用Java初级内容充数!不用与大数据岗位无关内容占课时!我们做的就是“精华版”大数据课程
了解课程
恭喜解决一个难题,获得1积分~
来为老师/同学的回答评分吧
0 星