3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 591 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
40 ms
Locality Level Summary:
Any: 1
Associated Job Ids:
287
DAG Visualization
digraph G { subgraph clusterstage_591 { label="Stage 591"; subgraph cluster7900 { label="AQEShuffleRead"; 3035 [labelType="html" label="ShuffledRowRDD [3035] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7897 { label="WholeStageCodegen (18)"; 3036 [labelType="html" label="MapPartitionsRDD [3036] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7905 { label="AQEShuffleRead"; 3037 [labelType="html" label="ShuffledRowRDD [3037] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7902 { label="WholeStageCodegen (19)"; 3038 [labelType="html" label="MapPartitionsRDD [3038] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7893 { label="WholeStageCodegen (20)"; 3039 [labelType="html" label="ZippedPartitionsRDD2 [3039] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3040 [labelType="html" label="MapPartitionsRDD [3040] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7892 { label="ObjectHashAggregate"; 3041 [labelType="html" label="MapPartitionsRDD [3041] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7891 { label="Exchange"; 3042 [labelType="html" label="MapPartitionsRDD [3042] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3035->3036; 3037->3038; 3036->3039; 3038->3039; 3039->3040; 3040->3041; 3041->3042; }
3034,3035
3029,3037
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time