3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 840 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
21 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
145.5 KiB / 1571
Associated Job Ids:
652
DAG Visualization
digraph G { subgraph clusterstage_840 { label="Stage 840"; subgraph cluster5526 { label="AQEShuffleRead"; 2138 [labelType="html" label="ShuffledRowRDD [2138] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5523 { label="WholeStageCodegen (3)"; 2139 [labelType="html" label="MapPartitionsRDD [2139] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5522 { label="Window"; 2140 [labelType="html" label="MapPartitionsRDD [2140] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5518 { label="WholeStageCodegen (4)"; 2141 [labelType="html" label="MapPartitionsRDD [2141] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5531 { label="AQEShuffleRead"; 2142 [labelType="html" label="ShuffledRowRDD [2142] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5528 { label="WholeStageCodegen (5)"; 2143 [labelType="html" label="MapPartitionsRDD [2143] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5514 { label="WholeStageCodegen (6)"; 2144 [labelType="html" label="ZippedPartitionsRDD2 [2144] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 2145 [labelType="html" label="MapPartitionsRDD [2145] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5532 { label="mapPartitionsInternal"; 2146 [labelType="html" label="MapPartitionsRDD [2146] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2138->2139; 2139->2140; 2140->2141; 2142->2143; 2141->2144; 2143->2144; 2144->2145; 2145->2146; }
2128,2138
2130,2142
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time