3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 43 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 5
Input Size / Records:
10.3 MiB / 24850
Shuffle Write Size / Records:
1302.5 KiB / 24850
Associated Job Ids:
30
DAG Visualization
digraph G { subgraph clusterstage_43 { label="Stage 43"; subgraph cluster406 { label="Scan csv "; 211 [labelType="html" label="FileScanRDD [211]<br>takeAsList at DataFrameCommonJob.java:145"]; 212 [labelType="html" label="MapPartitionsRDD [212]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster402 { label="WholeStageCodegen (1)"; 213 [labelType="html" label="MapPartitionsRDD [213]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster411 { label="Scan csv "; 214 [labelType="html" label="FileScanRDD [214]<br>takeAsList at DataFrameCommonJob.java:145"]; 215 [labelType="html" label="MapPartitionsRDD [215]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster407 { label="WholeStageCodegen (2)"; 216 [labelType="html" label="MapPartitionsRDD [216]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster416 { label="Scan csv "; 217 [labelType="html" label="FileScanRDD [217]<br>takeAsList at DataFrameCommonJob.java:145"]; 218 [labelType="html" label="MapPartitionsRDD [218]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster412 { label="WholeStageCodegen (3)"; 219 [labelType="html" label="MapPartitionsRDD [219]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster421 { label="Scan csv "; 220 [labelType="html" label="FileScanRDD [220]<br>takeAsList at DataFrameCommonJob.java:145"]; 221 [labelType="html" label="MapPartitionsRDD [221]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster417 { label="WholeStageCodegen (4)"; 222 [labelType="html" label="MapPartitionsRDD [222]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster426 { label="Scan csv "; 223 [labelType="html" label="FileScanRDD [223]<br>takeAsList at DataFrameCommonJob.java:145"]; 224 [labelType="html" label="MapPartitionsRDD [224]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster422 { label="WholeStageCodegen (5)"; 225 [labelType="html" label="MapPartitionsRDD [225]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster401 { label="Union"; 226 [labelType="html" label="UnionRDD [226]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster400 { label="Exchange"; 227 [labelType="html" label="MapPartitionsRDD [227]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 211->212; 212->213; 214->215; 215->216; 217->218; 218->219; 220->221; 221->222; 223->224; 224->225; 213->226; 216->226; 219->226; 222->226; 225->226; 226->227; }
Event Timeline
Enable zooming
Tasks: 5. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time