3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 6 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
1 s
Locality Level Summary:
Process local: 2
Input Size / Records:
145.3 KiB / 1308
Shuffle Write Size / Records:
84.0 KiB / 993
Associated Job Ids:
6
DAG Visualization
digraph G { subgraph clusterstage_6 { label="Stage 6"; subgraph cluster65 { label="Scan csv "; 33 [labelType="html" label="FileScanRDD [33]<br>toJavaRDD at AbsExportExecutor.java:55"]; 34 [labelType="html" label="MapPartitionsRDD [34]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster61 { label="WholeStageCodegen (1)"; 35 [labelType="html" label="MapPartitionsRDD [35]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster71 { label="Scan parquet "; 36 [labelType="html" label="FileScanRDD [36]<br>toJavaRDD at AbsExportExecutor.java:55"]; 37 [labelType="html" label="MapPartitionsRDD [37]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster66 { label="WholeStageCodegen (2)"; 38 [labelType="html" label="MapPartitionsRDD [38]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster60 { label="Union"; 39 [labelType="html" label="UnionRDD [39]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster59 { label="Exchange"; 40 [labelType="html" label="MapPartitionsRDD [40]<br>toJavaRDD at AbsExportExecutor.java:55"]; } } 33->34; 34->35; 36->37; 37->38; 35->39; 38->39; 39->40; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time