3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 641 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
90 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
145.5 KiB / 1571
Associated Job Ids:
513
DAG Visualization
digraph G { subgraph clusterstage_641 { label="Stage 641"; subgraph cluster4169 { label="AQEShuffleRead"; 1586 [labelType="html" label="ShuffledRowRDD [1586] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4166 { label="WholeStageCodegen (3)"; 1587 [labelType="html" label="MapPartitionsRDD [1587] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4165 { label="Window"; 1588 [labelType="html" label="MapPartitionsRDD [1588] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4162 { label="WholeStageCodegen (4)"; 1589 [labelType="html" label="MapPartitionsRDD [1589] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4177 { label="AQEShuffleRead"; 1590 [labelType="html" label="ShuffledRowRDD [1590] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4171 { label="WholeStageCodegen (5)"; 1593 [labelType="html" label="MapPartitionsRDD [1593] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4158 { label="WholeStageCodegen (6)"; 1595 [labelType="html" label="ZippedPartitionsRDD2 [1595] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 1596 [labelType="html" label="MapPartitionsRDD [1596] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4182 { label="mapPartitionsInternal"; 1597 [labelType="html" label="MapPartitionsRDD [1597] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 1586->1587; 1587->1588; 1588->1589; 1590->1593; 1589->1595; 1593->1595; 1595->1596; 1596->1597; }
1576,1586
1578,1590
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time