3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 442 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.6 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
155.3 KiB / 618009
Shuffle Write Size / Records:
104.0 B / 1
Associated Job Ids:
225
DAG Visualization
digraph G { subgraph clusterstage_442 { label="Stage 442"; subgraph cluster5879 { label="AQEShuffleRead"; 2291 [labelType="html" label="ShuffledRowRDD [2291] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5876 { label="WholeStageCodegen (16)"; 2292 [labelType="html" label="MapPartitionsRDD [2292] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5884 { label="AQEShuffleRead"; 2293 [labelType="html" label="ShuffledRowRDD [2293] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5881 { label="WholeStageCodegen (17)"; 2294 [labelType="html" label="MapPartitionsRDD [2294] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5872 { label="WholeStageCodegen (18)"; 2295 [labelType="html" label="ZippedPartitionsRDD2 [2295] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 2296 [labelType="html" label="MapPartitionsRDD [2296] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5871 { label="SortAggregate"; 2297 [labelType="html" label="MapPartitionsRDD [2297] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5870 { label="Exchange"; 2298 [labelType="html" label="MapPartitionsRDD [2298] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2291->2292; 2293->2294; 2292->2295; 2294->2295; 2295->2296; 2296->2297; 2297->2298; }
2286,2291
2290,2293
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time