3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 158 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
235.2 KiB / 618009
Shuffle Write Size / Records:
86.0 B / 1
Associated Job Ids:
102
DAG Visualization
digraph G { subgraph clusterstage_158 { label="Stage 158"; subgraph cluster1700 { label="AQEShuffleRead"; 722 [labelType="html" label="ShuffledRowRDD [722] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1697 { label="WholeStageCodegen (16)"; 723 [labelType="html" label="MapPartitionsRDD [723] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1705 { label="AQEShuffleRead"; 724 [labelType="html" label="ShuffledRowRDD [724] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1702 { label="WholeStageCodegen (17)"; 725 [labelType="html" label="MapPartitionsRDD [725] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1693 { label="WholeStageCodegen (18)"; 726 [labelType="html" label="ZippedPartitionsRDD2 [726] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 727 [labelType="html" label="MapPartitionsRDD [727] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1692 { label="SortAggregate"; 728 [labelType="html" label="MapPartitionsRDD [728] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1691 { label="Exchange"; 729 [labelType="html" label="MapPartitionsRDD [729] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 722->723; 724->725; 723->726; 725->726; 726->727; 727->728; 728->729; }
717,722
721,724
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time