3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 324 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
175.0 KiB / 618009
Shuffle Write Size / Records:
9.2 KiB / 1
Associated Job Ids:
172
DAG Visualization
digraph G { subgraph clusterstage_324 { label="Stage 324"; subgraph cluster4020 { label="AQEShuffleRead"; 1591 [labelType="html" label="ShuffledRowRDD [1591] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4017 { label="WholeStageCodegen (18)"; 1592 [labelType="html" label="MapPartitionsRDD [1592] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4025 { label="AQEShuffleRead"; 1593 [labelType="html" label="ShuffledRowRDD [1593] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4022 { label="WholeStageCodegen (19)"; 1594 [labelType="html" label="MapPartitionsRDD [1594] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4013 { label="WholeStageCodegen (20)"; 1595 [labelType="html" label="ZippedPartitionsRDD2 [1595] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 1596 [labelType="html" label="MapPartitionsRDD [1596] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4012 { label="ObjectHashAggregate"; 1597 [labelType="html" label="MapPartitionsRDD [1597] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4011 { label="Exchange"; 1598 [labelType="html" label="MapPartitionsRDD [1598] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 1591->1592; 1593->1594; 1592->1595; 1594->1595; 1595->1596; 1596->1597; 1597->1598; }
1584,1591
1579,1593
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time