3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 623 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
4 s
Locality Level Summary:
Any: 5
Shuffle Read Size / Records:
8.9 MiB / 146055
Shuffle Write Size / Records:
16.9 MiB / 138151
Associated Job Ids:
309
DAG Visualization
digraph G { subgraph clusterstage_623 { label="Stage 623"; subgraph cluster8091 { label="AQEShuffleRead"; 3111 [labelType="html" label="ShuffledRowRDD [3111] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8088 { label="WholeStageCodegen (3)"; 3112 [labelType="html" label="MapPartitionsRDD [3112] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8096 { label="AQEShuffleRead"; 3113 [labelType="html" label="ShuffledRowRDD [3113] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8093 { label="WholeStageCodegen (4)"; 3114 [labelType="html" label="MapPartitionsRDD [3114] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8084 { label="WholeStageCodegen (5)"; 3115 [labelType="html" label="ZippedPartitionsRDD2 [3115] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3116 [labelType="html" label="MapPartitionsRDD [3116] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8083 { label="Exchange"; 3117 [labelType="html" label="MapPartitionsRDD [3117] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3111->3112; 3113->3114; 3112->3115; 3114->3115; 3115->3116; 3116->3117; }
3103,3111
3107,3113
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time