3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 254 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
177.3 KiB / 618009
Shuffle Write Size / Records:
14.1 KiB / 1
Associated Job Ids:
142
DAG Visualization
digraph G { subgraph clusterstage_254 { label="Stage 254"; subgraph cluster3137 { label="AQEShuffleRead"; 1255 [labelType="html" label="ShuffledRowRDD [1255] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3134 { label="WholeStageCodegen (18)"; 1256 [labelType="html" label="MapPartitionsRDD [1256] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3142 { label="AQEShuffleRead"; 1257 [labelType="html" label="ShuffledRowRDD [1257] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3139 { label="WholeStageCodegen (19)"; 1258 [labelType="html" label="MapPartitionsRDD [1258] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3130 { label="WholeStageCodegen (20)"; 1259 [labelType="html" label="ZippedPartitionsRDD2 [1259] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 1260 [labelType="html" label="MapPartitionsRDD [1260] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3129 { label="ObjectHashAggregate"; 1261 [labelType="html" label="MapPartitionsRDD [1261] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster3128 { label="Exchange"; 1262 [labelType="html" label="MapPartitionsRDD [1262] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 1255->1256; 1257->1258; 1256->1259; 1258->1259; 1259->1260; 1260->1261; 1261->1262; }
1254,1255
1249,1257
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time