3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 1174 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
29 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
145.5 KiB / 1571
Associated Job Ids:
912
DAG Visualization
digraph G { subgraph clusterstage_1174 { label="Stage 1174"; subgraph cluster8032 { label="AQEShuffleRead"; 3074 [labelType="html" label="ShuffledRowRDD [3074] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8029 { label="WholeStageCodegen (3)"; 3075 [labelType="html" label="MapPartitionsRDD [3075] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8028 { label="Window"; 3076 [labelType="html" label="MapPartitionsRDD [3076] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8024 { label="WholeStageCodegen (4)"; 3077 [labelType="html" label="MapPartitionsRDD [3077] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8045 { label="AQEShuffleRead"; 3078 [labelType="html" label="ShuffledRowRDD [3078] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8042 { label="WholeStageCodegen (5)"; 3079 [labelType="html" label="MapPartitionsRDD [3079] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8020 { label="WholeStageCodegen (6)"; 3080 [labelType="html" label="ZippedPartitionsRDD2 [3080] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3081 [labelType="html" label="MapPartitionsRDD [3081] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8046 { label="mapPartitionsInternal"; 3082 [labelType="html" label="MapPartitionsRDD [3082] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3074->3075; 3075->3076; 3076->3077; 3078->3079; 3077->3080; 3079->3080; 3080->3081; 3081->3082; }
3067,3074
3072,3078
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time