3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 469 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
236.2 KiB / 618009
Shuffle Write Size / Records:
90.0 B / 1
Associated Job Ids:
237
DAG Visualization
digraph G { subgraph clusterstage_469 { label="Stage 469"; subgraph cluster6344 { label="AQEShuffleRead"; 2462 [labelType="html" label="ShuffledRowRDD [2462] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6341 { label="WholeStageCodegen (16)"; 2463 [labelType="html" label="MapPartitionsRDD [2463] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6349 { label="AQEShuffleRead"; 2464 [labelType="html" label="ShuffledRowRDD [2464] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6346 { label="WholeStageCodegen (17)"; 2465 [labelType="html" label="MapPartitionsRDD [2465] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6337 { label="WholeStageCodegen (18)"; 2466 [labelType="html" label="ZippedPartitionsRDD2 [2466] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 2467 [labelType="html" label="MapPartitionsRDD [2467] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6336 { label="SortAggregate"; 2468 [labelType="html" label="MapPartitionsRDD [2468] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6335 { label="Exchange"; 2469 [labelType="html" label="MapPartitionsRDD [2469] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2462->2463; 2464->2465; 2463->2466; 2465->2466; 2466->2467; 2467->2468; 2468->2469; }
2457,2462
2461,2464
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time