3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 1190 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
27 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
145.5 KiB / 1571
Associated Job Ids:
922
DAG Visualization
digraph G { subgraph clusterstage_1190 { label="Stage 1190"; subgraph cluster8185 { label="AQEShuffleRead"; 3127 [labelType="html" label="ShuffledRowRDD [3127] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8182 { label="WholeStageCodegen (3)"; 3128 [labelType="html" label="MapPartitionsRDD [3128] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8181 { label="Window"; 3129 [labelType="html" label="MapPartitionsRDD [3129] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8178 { label="WholeStageCodegen (4)"; 3130 [labelType="html" label="MapPartitionsRDD [3130] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8190 { label="AQEShuffleRead"; 3131 [labelType="html" label="ShuffledRowRDD [3131] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8187 { label="WholeStageCodegen (5)"; 3132 [labelType="html" label="MapPartitionsRDD [3132] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8174 { label="WholeStageCodegen (6)"; 3133 [labelType="html" label="ZippedPartitionsRDD2 [3133] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3134 [labelType="html" label="MapPartitionsRDD [3134] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8191 { label="mapPartitionsInternal"; 3135 [labelType="html" label="MapPartitionsRDD [3135] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3127->3128; 3128->3129; 3129->3130; 3131->3132; 3130->3133; 3132->3133; 3133->3134; 3134->3135; }
3122,3127
3126,3131
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time