TopNAnchorScala运行没报错，控制台看不到输出结果

TopNAnchorScala运行没报错，控制台看不到输出结果

21/06/10 14:29:18 INFO Executor: Finished task 168.0 in stage 14.0 (TID 972). 6674 bytes result sent to driver

21/06/10 14:29:18 INFO TaskSetManager: Starting task 169.0 in stage 14.0 (TID 973) (DESKTOP-T446KK7, executor driver, partition 169, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:18 INFO Executor: Running task 169.0 in stage 14.0 (TID 973)

21/06/10 14:29:18 INFO TaskSetManager: Finished task 168.0 in stage 14.0 (TID 972) in 5 ms on DESKTOP-T446KK7 (executor driver) (169/200)

21/06/10 14:29:18 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:18 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:18 INFO Executor: Finished task 169.0 in stage 14.0 (TID 973). 6674 bytes result sent to driver

21/06/10 14:29:18 INFO TaskSetManager: Starting task 170.0 in stage 14.0 (TID 974) (DESKTOP-T446KK7, executor driver, partition 170, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:18 INFO Executor: Running task 170.0 in stage 14.0 (TID 974)

21/06/10 14:29:18 INFO TaskSetManager: Finished task 169.0 in stage 14.0 (TID 973) in 5 ms on DESKTOP-T446KK7 (executor driver) (170/200)

21/06/10 14:29:18 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:18 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:18 INFO Executor: Finished task 170.0 in stage 14.0 (TID 974). 6717 bytes result sent to driver

21/06/10 14:29:18 INFO TaskSetManager: Starting task 171.0 in stage 14.0 (TID 975) (DESKTOP-T446KK7, executor driver, partition 171, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:18 INFO Executor: Running task 171.0 in stage 14.0 (TID 975)

21/06/10 14:29:18 INFO TaskSetManager: Finished task 170.0 in stage 14.0 (TID 974) in 4 ms on DESKTOP-T446KK7 (executor driver) (171/200)

21/06/10 14:29:18 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:18 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:18 INFO Executor: Finished task 171.0 in stage 14.0 (TID 975). 6674 bytes result sent to driver

21/06/10 14:29:18 INFO TaskSetManager: Starting task 172.0 in stage 14.0 (TID 976) (DESKTOP-T446KK7, executor driver, partition 172, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:18 INFO TaskSetManager: Finished task 171.0 in stage 14.0 (TID 975) in 5 ms on DESKTOP-T446KK7 (executor driver) (172/200)

21/06/10 14:29:18 INFO Executor: Running task 172.0 in stage 14.0 (TID 976)

21/06/10 14:29:18 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:18 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:18 INFO Executor: Finished task 172.0 in stage 14.0 (TID 976). 6674 bytes result sent to driver

21/06/10 14:29:18 INFO TaskSetManager: Starting task 173.0 in stage 14.0 (TID 977) (DESKTOP-T446KK7, executor driver, partition 173, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:18 INFO Executor: Running task 173.0 in stage 14.0 (TID 977)

21/06/10 14:29:18 INFO TaskSetManager: Finished task 172.0 in stage 14.0 (TID 976) in 5 ms on DESKTOP-T446KK7 (executor driver) (173/200)

21/06/10 14:29:18 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:18 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:18 INFO Executor: Finished task 173.0 in stage 14.0 (TID 977). 6717 bytes result sent to driver

21/06/10 14:29:18 INFO TaskSetManager: Starting task 174.0 in stage 14.0 (TID 978) (DESKTOP-T446KK7, executor driver, partition 174, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:18 INFO Executor: Running task 174.0 in stage 14.0 (TID 978)

21/06/10 14:29:18 INFO TaskSetManager: Finished task 173.0 in stage 14.0 (TID 977) in 5 ms on DESKTOP-T446KK7 (executor driver) (174/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 174.0 in stage 14.0 (TID 978). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 175.0 in stage 14.0 (TID 979) (DESKTOP-T446KK7, executor driver, partition 175, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 175.0 in stage 14.0 (TID 979)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 174.0 in stage 14.0 (TID 978) in 4 ms on DESKTOP-T446KK7 (executor driver) (175/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 175.0 in stage 14.0 (TID 979). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 176.0 in stage 14.0 (TID 980) (DESKTOP-T446KK7, executor driver, partition 176, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 176.0 in stage 14.0 (TID 980)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 175.0 in stage 14.0 (TID 979) in 4 ms on DESKTOP-T446KK7 (executor driver) (176/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 176.0 in stage 14.0 (TID 980). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 177.0 in stage 14.0 (TID 981) (DESKTOP-T446KK7, executor driver, partition 177, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 177.0 in stage 14.0 (TID 981)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 176.0 in stage 14.0 (TID 980) in 5 ms on DESKTOP-T446KK7 (executor driver) (177/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 177.0 in stage 14.0 (TID 981). 6717 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 178.0 in stage 14.0 (TID 982) (DESKTOP-T446KK7, executor driver, partition 178, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 178.0 in stage 14.0 (TID 982)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 177.0 in stage 14.0 (TID 981) in 4 ms on DESKTOP-T446KK7 (executor driver) (178/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 178.0 in stage 14.0 (TID 982). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 179.0 in stage 14.0 (TID 983) (DESKTOP-T446KK7, executor driver, partition 179, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO TaskSetManager: Finished task 178.0 in stage 14.0 (TID 982) in 5 ms on DESKTOP-T446KK7 (executor driver) (179/200)

21/06/10 14:29:19 INFO Executor: Running task 179.0 in stage 14.0 (TID 983)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 179.0 in stage 14.0 (TID 983). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 180.0 in stage 14.0 (TID 984) (DESKTOP-T446KK7, executor driver, partition 180, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 180.0 in stage 14.0 (TID 984)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 179.0 in stage 14.0 (TID 983) in 4 ms on DESKTOP-T446KK7 (executor driver) (180/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 180.0 in stage 14.0 (TID 984). 6717 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 181.0 in stage 14.0 (TID 985) (DESKTOP-T446KK7, executor driver, partition 181, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 181.0 in stage 14.0 (TID 985)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 180.0 in stage 14.0 (TID 984) in 5 ms on DESKTOP-T446KK7 (executor driver) (181/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 181.0 in stage 14.0 (TID 985). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 182.0 in stage 14.0 (TID 986) (DESKTOP-T446KK7, executor driver, partition 182, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 182.0 in stage 14.0 (TID 986)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 181.0 in stage 14.0 (TID 985) in 4 ms on DESKTOP-T446KK7 (executor driver) (182/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 182.0 in stage 14.0 (TID 986). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 183.0 in stage 14.0 (TID 987) (DESKTOP-T446KK7, executor driver, partition 183, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 183.0 in stage 14.0 (TID 987)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 182.0 in stage 14.0 (TID 986) in 6 ms on DESKTOP-T446KK7 (executor driver) (183/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 183.0 in stage 14.0 (TID 987). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 184.0 in stage 14.0 (TID 988) (DESKTOP-T446KK7, executor driver, partition 184, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 184.0 in stage 14.0 (TID 988)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 183.0 in stage 14.0 (TID 987) in 4 ms on DESKTOP-T446KK7 (executor driver) (184/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 184.0 in stage 14.0 (TID 988). 6717 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 185.0 in stage 14.0 (TID 989) (DESKTOP-T446KK7, executor driver, partition 185, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 185.0 in stage 14.0 (TID 989)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 184.0 in stage 14.0 (TID 988) in 5 ms on DESKTOP-T446KK7 (executor driver) (185/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 185.0 in stage 14.0 (TID 989). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 186.0 in stage 14.0 (TID 990) (DESKTOP-T446KK7, executor driver, partition 186, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 186.0 in stage 14.0 (TID 990)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 185.0 in stage 14.0 (TID 989) in 8 ms on DESKTOP-T446KK7 (executor driver) (186/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 186.0 in stage 14.0 (TID 990). 6717 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 187.0 in stage 14.0 (TID 991) (DESKTOP-T446KK7, executor driver, partition 187, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 187.0 in stage 14.0 (TID 991)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 186.0 in stage 14.0 (TID 990) in 5 ms on DESKTOP-T446KK7 (executor driver) (187/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 187.0 in stage 14.0 (TID 991). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 188.0 in stage 14.0 (TID 992) (DESKTOP-T446KK7, executor driver, partition 188, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 188.0 in stage 14.0 (TID 992)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 187.0 in stage 14.0 (TID 991) in 5 ms on DESKTOP-T446KK7 (executor driver) (188/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 188.0 in stage 14.0 (TID 992). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 189.0 in stage 14.0 (TID 993) (DESKTOP-T446KK7, executor driver, partition 189, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 189.0 in stage 14.0 (TID 993)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 188.0 in stage 14.0 (TID 992) in 5 ms on DESKTOP-T446KK7 (executor driver) (189/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 189.0 in stage 14.0 (TID 993). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 190.0 in stage 14.0 (TID 994) (DESKTOP-T446KK7, executor driver, partition 190, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO TaskSetManager: Finished task 189.0 in stage 14.0 (TID 993) in 3 ms on DESKTOP-T446KK7 (executor driver) (190/200)

21/06/10 14:29:19 INFO Executor: Running task 190.0 in stage 14.0 (TID 994)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 190.0 in stage 14.0 (TID 994). 6717 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 191.0 in stage 14.0 (TID 995) (DESKTOP-T446KK7, executor driver, partition 191, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 191.0 in stage 14.0 (TID 995)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 190.0 in stage 14.0 (TID 994) in 4 ms on DESKTOP-T446KK7 (executor driver) (191/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 191.0 in stage 14.0 (TID 995). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 192.0 in stage 14.0 (TID 996) (DESKTOP-T446KK7, executor driver, partition 192, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 192.0 in stage 14.0 (TID 996)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 191.0 in stage 14.0 (TID 995) in 5 ms on DESKTOP-T446KK7 (executor driver) (192/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 192.0 in stage 14.0 (TID 996). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 193.0 in stage 14.0 (TID 997) (DESKTOP-T446KK7, executor driver, partition 193, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO TaskSetManager: Finished task 192.0 in stage 14.0 (TID 996) in 4 ms on DESKTOP-T446KK7 (executor driver) (193/200)

21/06/10 14:29:19 INFO Executor: Running task 193.0 in stage 14.0 (TID 997)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 193.0 in stage 14.0 (TID 997). 6717 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 194.0 in stage 14.0 (TID 998) (DESKTOP-T446KK7, executor driver, partition 194, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 194.0 in stage 14.0 (TID 998)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 193.0 in stage 14.0 (TID 997) in 5 ms on DESKTOP-T446KK7 (executor driver) (194/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 194.0 in stage 14.0 (TID 998). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 195.0 in stage 14.0 (TID 999) (DESKTOP-T446KK7, executor driver, partition 195, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 195.0 in stage 14.0 (TID 999)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 194.0 in stage 14.0 (TID 998) in 4 ms on DESKTOP-T446KK7 (executor driver) (195/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 195.0 in stage 14.0 (TID 999). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 196.0 in stage 14.0 (TID 1000) (DESKTOP-T446KK7, executor driver, partition 196, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 196.0 in stage 14.0 (TID 1000)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 195.0 in stage 14.0 (TID 999) in 4 ms on DESKTOP-T446KK7 (executor driver) (196/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 196.0 in stage 14.0 (TID 1000). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 197.0 in stage 14.0 (TID 1001) (DESKTOP-T446KK7, executor driver, partition 197, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 197.0 in stage 14.0 (TID 1001)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 196.0 in stage 14.0 (TID 1000) in 6 ms on DESKTOP-T446KK7 (executor driver) (197/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 197.0 in stage 14.0 (TID 1001). 6717 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 198.0 in stage 14.0 (TID 1002) (DESKTOP-T446KK7, executor driver, partition 198, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 198.0 in stage 14.0 (TID 1002)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 197.0 in stage 14.0 (TID 1001) in 5 ms on DESKTOP-T446KK7 (executor driver) (198/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 198.0 in stage 14.0 (TID 1002). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Starting task 199.0 in stage 14.0 (TID 1003) (DESKTOP-T446KK7, executor driver, partition 199, PROCESS_LOCAL, 4453 bytes) taskResourceAssignments Map()

21/06/10 14:29:19 INFO Executor: Running task 199.0 in stage 14.0 (TID 1003)

21/06/10 14:29:19 INFO TaskSetManager: Finished task 198.0 in stage 14.0 (TID 1002) in 4 ms on DESKTOP-T446KK7 (executor driver) (199/200)

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Getting 0 (0.0 B) non-empty blocks including 0 (0.0 B) local and 0 (0.0 B) host-local and 0 (0.0 B) remote blocks

21/06/10 14:29:19 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms

21/06/10 14:29:19 INFO Executor: Finished task 199.0 in stage 14.0 (TID 1003). 6674 bytes result sent to driver

21/06/10 14:29:19 INFO TaskSetManager: Finished task 199.0 in stage 14.0 (TID 1003) in 5 ms on DESKTOP-T446KK7 (executor driver) (200/200)

21/06/10 14:29:19 INFO TaskSchedulerImpl: Removed TaskSet 14.0, whose tasks have all completed, from pool 

21/06/10 14:29:19 INFO DAGScheduler: ResultStage 14 (foreach at TopNAnchorScala.scala:71) finished in 1.191 s

21/06/10 14:29:19 INFO DAGScheduler: Job 5 is finished. Cancelling potential speculative or zombie tasks for this job

21/06/10 14:29:19 INFO TaskSchedulerImpl: Killing all running tasks in stage 14: Stage finished

21/06/10 14:29:19 INFO DAGScheduler: Job 5 finished: foreach at TopNAnchorScala.scala:71, took 1.198024 s

21/06/10 14:29:19 INFO SparkUI: Stopped Spark web UI at http://DESKTOP-T446KK7:4040

21/06/10 14:29:19 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!

21/06/10 14:29:19 INFO MemoryStore: MemoryStore cleared

21/06/10 14:29:19 INFO BlockManager: BlockManager stopped

21/06/10 14:29:19 INFO BlockManagerMaster: BlockManagerMaster stopped

21/06/10 14:29:19 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!

21/06/10 14:29:19 INFO SparkContext: Successfully stopped SparkContext

21/06/10 14:29:19 INFO ShutdownHookManager: Shutdown hook called

21/06/10 14:29:19 INFO ShutdownHookManager: Deleting directory C:\Users\ASUS.DESKTOP-T446KK7\AppData\Local\Temp\spark-a2e4b77b-48e9-46ac-b3ed-a7aac042b955

问题描述：

控制台没看到输出结果
夜星坠 2021-06-10
源自：Spark性能优化的道与术   7-1 实战：TopN主播统计-1
6
收起

正在回答

登陆购买课程后可参与讨论，去登陆吧

1回答
徐老师 回答被采纳获得+3积分 2021-06-10 14:37:42

程序执行了，没有报错，也没有输出结果，要么是原始数据有问题，或者是计算逻辑层面的问题，可以按照下面这个思路排查一下


挨个调试一下每一个transformation算子执行后的结果。

先把后面的算子代码注释掉，从前面的算子开始，在每个transformation后面都调用foreach打印一下，看看数据在每一步中的变化情况，这样可以看出来到底是在哪一步开始没有数据的

0
收起回答
  • 夜星坠 提问者 #1

    老师我找了好久发现我的运行结果在后台一堆info日志中间是为什么，不像视频里往上翻翻就有http://img1.sycdn.imooc.com//climg/60c1b5d609c8401c18360694.jpg​

    2021-06-10 14:51:31
  • 徐老师 回复 提问者 夜星坠 #2

    这属于正常，打印程序在往控制台打印的时候，有一些日志可能还没打印完，所以结果数据就混到日志里面了，正常现象。

    可以把log4j中日志的级别修改为error级别，这样基本上就没有什么额外的日志了

    2021-06-10 15:11:31
问题已解决，确定采纳
还有疑问，暂不采纳

恭喜解决一个难题，获得1积分~

来为老师/同学的回答评分吧

0 星

相似问题

为什么控制台不输出内容哎
23 0 7
控制台报错
8 0 5
IntelliJ Idea输出在控制台显示不出来
20 0 4
运行程序控制台不能自动弹出了
10 0 3
控制台乱码问题
9 0 3

登录后可查看更多问答，登录/注册

大数据工程师 2024 版
  • 参与学习       1151    人
  • 提交作业       5960    份
  • 解答问题       1144    个

不用Java初级内容充数！不用与大数据岗位无关内容占课时！我们做的就是“精华版”大数据课程

了解课程

本课精华内容

问答 作业

老师，每个比较大的文件都会分割成块保存在DataNode中，那就说一个datanode坏了导致整个文件不可用，这样不就减低了可靠性吗？

54 2

对多个executor并行处理，对数据进行去重，这样会不会有重复数据

31 1

数据倾斜问题

78 5

并行度调优疑问

29 9

yum install -y ntpdate执行报错

17 20

查看更多本课问答
请稍等 ...
意见反馈 帮助中心 APP下载
官方微信

在线咨询

领取优惠

免费试听

领取大纲

扫描二维码，添加
你的专属老师