3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 50 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
83 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
1353.0 KiB / 26872
Associated Job Ids:
33
DAG Visualization
digraph G { subgraph clusterstage_50 { label="Stage 50"; subgraph cluster455 { label="AQEShuffleRead"; 239 [labelType="html" label="ShuffledRowRDD [239] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster452 { label="WholeStageCodegen (7)"; 240 [labelType="html" label="MapPartitionsRDD [240] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster460 { label="AQEShuffleRead"; 241 [labelType="html" label="ShuffledRowRDD [241] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster457 { label="WholeStageCodegen (8)"; 242 [labelType="html" label="MapPartitionsRDD [242] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster448 { label="WholeStageCodegen (9)"; 243 [labelType="html" label="ZippedPartitionsRDD2 [243] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 244 [labelType="html" label="MapPartitionsRDD [244] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster461 { label="mapPartitionsInternal"; 245 [labelType="html" label="MapPartitionsRDD [245] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 239->240; 241->242; 240->243; 242->243; 243->244; 244->245; }
227,239
231,241
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time