3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 843 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
26 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
145.5 KiB / 1571
Associated Job Ids:
653
DAG Visualization
digraph G { subgraph clusterstage_843 { label="Stage 843"; subgraph cluster5560 { label="AQEShuffleRead"; 2147 [labelType="html" label="ShuffledRowRDD [2147] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5557 { label="WholeStageCodegen (3)"; 2148 [labelType="html" label="MapPartitionsRDD [2148] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5556 { label="Window"; 2149 [labelType="html" label="MapPartitionsRDD [2149] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5553 { label="WholeStageCodegen (4)"; 2150 [labelType="html" label="MapPartitionsRDD [2150] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5565 { label="AQEShuffleRead"; 2151 [labelType="html" label="ShuffledRowRDD [2151] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5562 { label="WholeStageCodegen (5)"; 2152 [labelType="html" label="MapPartitionsRDD [2152] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5549 { label="WholeStageCodegen (6)"; 2153 [labelType="html" label="ZippedPartitionsRDD2 [2153] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 2154 [labelType="html" label="MapPartitionsRDD [2154] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster5566 { label="mapPartitionsInternal"; 2155 [labelType="html" label="MapPartitionsRDD [2155] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2147->2148; 2148->2149; 2149->2150; 2151->2152; 2150->2153; 2152->2153; 2153->2154; 2154->2155; }
2135,2147
2137,2151
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time