3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 1127 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.1 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
145.5 KiB / 1571
Associated Job Ids:
880
DAG Visualization
digraph G { subgraph clusterstage_1127 { label="Stage 1127"; subgraph cluster7757 { label="AQEShuffleRead"; 2977 [labelType="html" label="ShuffledRowRDD [2977] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7754 { label="WholeStageCodegen (3)"; 2978 [labelType="html" label="MapPartitionsRDD [2978] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7753 { label="Window"; 2979 [labelType="html" label="MapPartitionsRDD [2979] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7750 { label="WholeStageCodegen (4)"; 2980 [labelType="html" label="MapPartitionsRDD [2980] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7762 { label="AQEShuffleRead"; 2981 [labelType="html" label="ShuffledRowRDD [2981] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7759 { label="WholeStageCodegen (5)"; 2982 [labelType="html" label="MapPartitionsRDD [2982] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7746 { label="WholeStageCodegen (6)"; 2983 [labelType="html" label="ZippedPartitionsRDD2 [2983] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 2984 [labelType="html" label="MapPartitionsRDD [2984] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster7763 { label="mapPartitionsInternal"; 2985 [labelType="html" label="MapPartitionsRDD [2985] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2977->2978; 2978->2979; 2979->2980; 2981->2982; 2980->2983; 2982->2983; 2983->2984; 2984->2985; }
2969,2977
2973,2981
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time