3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 395 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.9 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
288.1 KiB / 618009
Shuffle Write Size / Records:
93.0 B / 1
Associated Job Ids:
206
DAG Visualization
digraph G { subgraph clusterstage_395 { label="Stage 395"; subgraph cluster5157 { label="AQEShuffleRead"; 2046 [labelType="html" label="ShuffledRowRDD [2046] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5154 { label="WholeStageCodegen (16)"; 2047 [labelType="html" label="MapPartitionsRDD [2047] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5162 { label="AQEShuffleRead"; 2048 [labelType="html" label="ShuffledRowRDD [2048] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5159 { label="WholeStageCodegen (17)"; 2049 [labelType="html" label="MapPartitionsRDD [2049] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5150 { label="WholeStageCodegen (18)"; 2050 [labelType="html" label="ZippedPartitionsRDD2 [2050] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 2051 [labelType="html" label="MapPartitionsRDD [2051] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5149 { label="SortAggregate"; 2052 [labelType="html" label="MapPartitionsRDD [2052] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5148 { label="Exchange"; 2053 [labelType="html" label="MapPartitionsRDD [2053] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2046->2047; 2048->2049; 2047->2050; 2049->2050; 2050->2051; 2051->2052; 2052->2053; }
2036,2046
2040,2048
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time