3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 120 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
91 ms
Locality Level Summary:
Any: 1
Shuffle Read Size / Records:
748.0 B / 17
Associated Job Ids:
89
DAG Visualization
digraph G { subgraph clusterstage_120 { label="Stage 120"; subgraph cluster961 { label="AQEShuffleRead"; 460 [labelType="html" label="ShuffledRowRDD [460] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster958 { label="WholeStageCodegen (2)"; 461 [labelType="html" label="MapPartitionsRDD [461] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster957 { label="Window"; 462 [labelType="html" label="MapPartitionsRDD [462] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster954 { label="WholeStageCodegen (3)"; 463 [labelType="html" label="MapPartitionsRDD [463] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster953 { label="Window"; 464 [labelType="html" label="MapPartitionsRDD [464] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster949 { label="WholeStageCodegen (4)"; 465 [labelType="html" label="MapPartitionsRDD [465] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster948 { label="Window"; 466 [labelType="html" label="MapPartitionsRDD [466] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster944 { label="WholeStageCodegen (5)"; 467 [labelType="html" label="MapPartitionsRDD [467] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster962 { label="mapPartitionsInternal"; 468 [labelType="html" label="MapPartitionsRDD [468] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 460->461; 461->462; 462->463; 463->464; 464->465; 465->466; 466->467; 467->468; }
451,460
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time