3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 66 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
748.0 B / 17
Shuffle Write Size / Records:
299.0 B / 9
Associated Job Ids:
51
DAG Visualization
digraph G { subgraph clusterstage_66 { label="Stage 66"; subgraph cluster562 { label="AQEShuffleRead"; 289 [labelType="html" label="ShuffledRowRDD [289] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster556 { label="WholeStageCodegen (2)"; 291 [labelType="html" label="MapPartitionsRDD [291] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster555 { label="Window"; 293 [labelType="html" label="MapPartitionsRDD [293] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster551 { label="WholeStageCodegen (3)"; 296 [labelType="html" label="MapPartitionsRDD [296] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster550 { label="Window"; 298 [labelType="html" label="MapPartitionsRDD [298] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster542 { label="WholeStageCodegen (4)"; 300 [labelType="html" label="MapPartitionsRDD [300] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster541 { label="Window"; 302 [labelType="html" label="MapPartitionsRDD [302] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster532 { label="WholeStageCodegen (5)"; 303 [labelType="html" label="MapPartitionsRDD [303] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster531 { label="Exchange"; 305 [labelType="html" label="MapPartitionsRDD [305] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 289->291; 291->293; 293->296; 296->298; 298->300; 300->302; 302->303; 303->305; }
288,289
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time