3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 176 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
155.3 KiB / 618009
Shuffle Write Size / Records:
104.0 B / 1
Associated Job Ids:
110
DAG Visualization
digraph G { subgraph clusterstage_176 { label="Stage 176"; subgraph cluster2008 { label="AQEShuffleRead"; 836 [labelType="html" label="ShuffledRowRDD [836] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2005 { label="WholeStageCodegen (16)"; 837 [labelType="html" label="MapPartitionsRDD [837] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2013 { label="AQEShuffleRead"; 838 [labelType="html" label="ShuffledRowRDD [838] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2010 { label="WholeStageCodegen (17)"; 839 [labelType="html" label="MapPartitionsRDD [839] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2001 { label="WholeStageCodegen (18)"; 840 [labelType="html" label="ZippedPartitionsRDD2 [840] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 841 [labelType="html" label="MapPartitionsRDD [841] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster2000 { label="SortAggregate"; 842 [labelType="html" label="MapPartitionsRDD [842] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster1999 { label="Exchange"; 843 [labelType="html" label="MapPartitionsRDD [843] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 836->837; 838->839; 837->840; 839->840; 840->841; 841->842; 842->843; }
831,836
835,838
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time