3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 827 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
23 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
145.5 KiB / 1571
Associated Job Ids:
644
DAG Visualization
digraph G { subgraph clusterstage_827 { label="Stage 827"; subgraph cluster5437 { label="AQEShuffleRead"; 2107 [labelType="html" label="ShuffledRowRDD [2107] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5434 { label="WholeStageCodegen (3)"; 2109 [labelType="html" label="MapPartitionsRDD [2109] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5433 { label="Window"; 2110 [labelType="html" label="MapPartitionsRDD [2110] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5424 { label="WholeStageCodegen (4)"; 2111 [labelType="html" label="MapPartitionsRDD [2111] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5442 { label="AQEShuffleRead"; 2112 [labelType="html" label="ShuffledRowRDD [2112] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5439 { label="WholeStageCodegen (5)"; 2113 [labelType="html" label="MapPartitionsRDD [2113] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5415 { label="WholeStageCodegen (6)"; 2114 [labelType="html" label="ZippedPartitionsRDD2 [2114] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 2115 [labelType="html" label="MapPartitionsRDD [2115] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5443 { label="mapPartitionsInternal"; 2116 [labelType="html" label="MapPartitionsRDD [2116] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2107->2109; 2109->2110; 2110->2111; 2112->2113; 2111->2114; 2113->2114; 2114->2115; 2115->2116; }
2098,2107
2100,2112
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time