3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 636 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
15 ms
Locality Level Summary:
Process local: 3
Input Size / Records:
7.2 KiB / 117
Shuffle Write Size / Records:
177.0 B / 3
Associated Job Ids:
319
DAG Visualization
digraph G { subgraph clusterstage_636 { label="Stage 636"; subgraph cluster8185 { label="Scan parquet "; 3145 [labelType="html" label="FileScanRDD [3145]<br>count at ColumnStatJob.java:47"]; 3146 [labelType="html" label="MapPartitionsRDD [3146]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8186 { label="Scan parquet "; 3147 [labelType="html" label="FileScanRDD [3147]<br>count at ColumnStatJob.java:47"]; 3148 [labelType="html" label="MapPartitionsRDD [3148]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8187 { label="Scan parquet "; 3149 [labelType="html" label="FileScanRDD [3149]<br>count at ColumnStatJob.java:47"]; 3150 [labelType="html" label="MapPartitionsRDD [3150]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8184 { label="Union"; 3151 [labelType="html" label="UnionRDD [3151]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8180 { label="WholeStageCodegen (1)"; 3152 [labelType="html" label="MapPartitionsRDD [3152]<br>count at ColumnStatJob.java:47"]; } subgraph cluster8179 { label="Exchange"; 3153 [labelType="html" label="MapPartitionsRDD [3153]<br>count at ColumnStatJob.java:47"]; } } 3145->3146; 3147->3148; 3149->3150; 3146->3151; 3148->3151; 3150->3151; 3151->3152; 3152->3153; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time