3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 460 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
700.1 KiB / 618009
Shuffle Write Size / Records:
239.0 B / 1
Associated Job Ids:
233
DAG Visualization
digraph G { subgraph clusterstage_460 { label="Stage 460"; subgraph cluster6189 { label="AQEShuffleRead"; 2405 [labelType="html" label="ShuffledRowRDD [2405] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6186 { label="WholeStageCodegen (16)"; 2406 [labelType="html" label="MapPartitionsRDD [2406] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6194 { label="AQEShuffleRead"; 2407 [labelType="html" label="ShuffledRowRDD [2407] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6191 { label="WholeStageCodegen (17)"; 2408 [labelType="html" label="MapPartitionsRDD [2408] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6182 { label="WholeStageCodegen (18)"; 2409 [labelType="html" label="ZippedPartitionsRDD2 [2409] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 2410 [labelType="html" label="MapPartitionsRDD [2410] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6181 { label="SortAggregate"; 2411 [labelType="html" label="MapPartitionsRDD [2411] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6180 { label="Exchange"; 2412 [labelType="html" label="MapPartitionsRDD [2412] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2405->2406; 2407->2408; 2406->2409; 2408->2409; 2409->2410; 2410->2411; 2411->2412; }
2400,2405
2404,2407
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time