3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
hdh-spark-job
application UI
Details for Stage 13 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Process local: 3
Input Size / Records:
2.9 MiB / 55314
Output Size / Records:
0.0 B / 55314
Associated Job Ids:
13
DAG Visualization
digraph G { subgraph clusterstage_13 { label="Stage 13"; 117 [labelType="html" label="JDBCRDD [117]<br>toJavaRDD at AbsExportExecutor.java:55"]; 127 [labelType="html" label="SQLExecutionRDD [127]<br>toJavaRDD at AbsExportExecutor.java:55"]; 132 [labelType="html" label="SQLExecutionRDD [132]<br>jdbc at SqlDbWriter.java:111"]; subgraph cluster215 { label="Scan csv "; 118 [labelType="html" label="FileScanRDD [118]<br>toJavaRDD at AbsExportExecutor.java:55"]; 119 [labelType="html" label="MapPartitionsRDD [119]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster212 { label="WholeStageCodegen (1)"; 120 [labelType="html" label="MapPartitionsRDD [120]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster216 { label="WholeStageCodegen (2)"; 121 [labelType="html" label="MapPartitionsRDD [121]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster223 { label="Scan parquet "; 122 [labelType="html" label="FileScanRDD [122]<br>toJavaRDD at AbsExportExecutor.java:55"]; 123 [labelType="html" label="MapPartitionsRDD [123]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster219 { label="WholeStageCodegen (3)"; 124 [labelType="html" label="MapPartitionsRDD [124]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster211 { label="Union"; 125 [labelType="html" label="UnionRDD [125]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster210 { label="DeserializeToObject"; 126 [labelType="html" label="MapPartitionsRDD [126]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster224 { label="mapPartitions"; 128 [labelType="html" label="MapPartitionsRDD [128]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster225 { label="map"; 129 [labelType="html" label="MapPartitionsRDD [129]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster227 { label="WholeStageCodegen (1)"; 130 [labelType="html" label="MapPartitionsRDD [130]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster226 { label="DeserializeToObject"; 131 [labelType="html" label="MapPartitionsRDD [131]<br>jdbc at SqlDbWriter.java:111"]; } subgraph cluster230 { label="mapPartitions"; 133 [labelType="html" label="MapPartitionsRDD [133]<br>jdbc at SqlDbWriter.java:111"]; } } 118->119; 119->120; 117->121; 122->123; 123->124; 120->125; 121->125; 124->125; 125->126; 126->127; 127->128; 128->129; 129->130; 130->131; 131->132; 132->133; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time