3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 32 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Any: 2
Shuffle Read Size / Records:
3.0 MiB / 65274
Associated Job Ids:
22
DAG Visualization
digraph G { subgraph clusterstage_32 { label="Stage 32"; subgraph cluster280 { label="AQEShuffleRead"; 151 [labelType="html" label="ShuffledRowRDD [151] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster277 { label="WholeStageCodegen (3)"; 152 [labelType="html" label="MapPartitionsRDD [152] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster285 { label="AQEShuffleRead"; 153 [labelType="html" label="ShuffledRowRDD [153] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster282 { label="WholeStageCodegen (4)"; 154 [labelType="html" label="MapPartitionsRDD [154] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster273 { label="WholeStageCodegen (5)"; 155 [labelType="html" label="ZippedPartitionsRDD2 [155] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 156 [labelType="html" label="MapPartitionsRDD [156] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster272 { label="TakeOrderedAndProject"; 157 [labelType="html" label="MapPartitionsRDD [157] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 158 [labelType="html" label="MapPartitionsRDD [158] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 151->152; 153->154; 152->155; 154->155; 155->156; 156->157; 157->158; }
139,151
143,153
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time