3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 481 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
0.7 s
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
177.3 KiB / 618009
Shuffle Write Size / Records:
15.2 KiB / 1
Associated Job Ids:
242
DAG Visualization
digraph G { subgraph clusterstage_481 { label="Stage 481"; subgraph cluster6508 { label="AQEShuffleRead"; 2524 [labelType="html" label="ShuffledRowRDD [2524] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6505 { label="WholeStageCodegen (18)"; 2525 [labelType="html" label="MapPartitionsRDD [2525] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6513 { label="AQEShuffleRead"; 2526 [labelType="html" label="ShuffledRowRDD [2526] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6510 { label="WholeStageCodegen (19)"; 2527 [labelType="html" label="MapPartitionsRDD [2527] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6501 { label="WholeStageCodegen (20)"; 2528 [labelType="html" label="ZippedPartitionsRDD2 [2528] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 2529 [labelType="html" label="MapPartitionsRDD [2529] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6500 { label="ObjectHashAggregate"; 2530 [labelType="html" label="MapPartitionsRDD [2530] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6499 { label="Exchange"; 2531 [labelType="html" label="MapPartitionsRDD [2531] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2524->2525; 2526->2527; 2525->2528; 2527->2528; 2528->2529; 2529->2530; 2530->2531; }
2523,2524
2518,2526
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time