3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 68 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.5 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
748.0 B / 17
Shuffle Write Size / Records:
59.0 B / 1
Associated Job Ids:
52
DAG Visualization
digraph G { subgraph clusterstage_68 { label="Stage 68"; subgraph cluster563 { label="AQEShuffleRead"; 290 [labelType="html" label="ShuffledRowRDD [290] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster557 { label="WholeStageCodegen (2)"; 292 [labelType="html" label="MapPartitionsRDD [292] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster554 { label="Window"; 294 [labelType="html" label="MapPartitionsRDD [294] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster547 { label="WholeStageCodegen (3)"; 295 [labelType="html" label="MapPartitionsRDD [295] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster546 { label="Window"; 297 [labelType="html" label="MapPartitionsRDD [297] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster537 { label="WholeStageCodegen (4)"; 299 [labelType="html" label="MapPartitionsRDD [299] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster536 { label="Window"; 301 [labelType="html" label="MapPartitionsRDD [301] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster526 { label="WholeStageCodegen (5)"; 304 [labelType="html" label="MapPartitionsRDD [304] [Unordered]<br>count at ColumnStatJob.java:47"]; } subgraph cluster525 { label="Exchange"; 306 [labelType="html" label="MapPartitionsRDD [306] [Unordered]<br>count at ColumnStatJob.java:47"]; } } 290->292; 292->294; 294->295; 295->297; 297->299; 299->301; 301->304; 304->306; }
287,290
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time