3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 662 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 5
Shuffle Read Size / Records:
8.9 MiB / 146055
Shuffle Write Size / Records:
16.9 MiB / 138151
Associated Job Ids:
336
DAG Visualization
digraph G { subgraph clusterstage_662 { label="Stage 662"; subgraph cluster8375 { label="AQEShuffleRead"; 3230 [labelType="html" label="ShuffledRowRDD [3230] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8372 { label="WholeStageCodegen (3)"; 3231 [labelType="html" label="MapPartitionsRDD [3231] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8380 { label="AQEShuffleRead"; 3232 [labelType="html" label="ShuffledRowRDD [3232] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8377 { label="WholeStageCodegen (4)"; 3233 [labelType="html" label="MapPartitionsRDD [3233] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8368 { label="WholeStageCodegen (5)"; 3234 [labelType="html" label="ZippedPartitionsRDD2 [3234] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 3235 [labelType="html" label="MapPartitionsRDD [3235] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster8367 { label="Exchange"; 3236 [labelType="html" label="MapPartitionsRDD [3236] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 3230->3231; 3232->3233; 3231->3234; 3233->3234; 3234->3235; 3235->3236; }
3225,3230
3229,3232
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time