3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 340 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
168.6 KiB / 618009
Shuffle Write Size / Records:
6.7 KiB / 1
Associated Job Ids:
180
DAG Visualization
digraph G { subgraph clusterstage_340 { label="Stage 340"; subgraph cluster4203 { label="AQEShuffleRead"; 1659 [labelType="html" label="ShuffledRowRDD [1659] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4200 { label="WholeStageCodegen (18)"; 1660 [labelType="html" label="MapPartitionsRDD [1660] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4208 { label="AQEShuffleRead"; 1661 [labelType="html" label="ShuffledRowRDD [1661] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4205 { label="WholeStageCodegen (19)"; 1662 [labelType="html" label="MapPartitionsRDD [1662] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4196 { label="WholeStageCodegen (20)"; 1663 [labelType="html" label="ZippedPartitionsRDD2 [1663] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 1664 [labelType="html" label="MapPartitionsRDD [1664] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4195 { label="ObjectHashAggregate"; 1665 [labelType="html" label="MapPartitionsRDD [1665] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4194 { label="Exchange"; 1666 [labelType="html" label="MapPartitionsRDD [1666] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 1659->1660; 1661->1662; 1660->1663; 1662->1663; 1663->1664; 1664->1665; 1665->1666; }
1658,1659
1653,1661
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time