3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 677 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 s
Locality Level Summary:
Any: 1
Output Size / Records:
8.9 MiB / 138151
Shuffle Read Size / Records:
16.9 MiB / 138151
Associated Job Ids:
343
DAG Visualization
digraph G { subgraph clusterstage_677 { label="Stage 677"; 3277 [labelType="html" label="SQLExecutionRDD [3277] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster8467 { label="Exchange"; 3272 [labelType="html" label="ShuffledRowRDD [3272] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8463 { label="WholeStageCodegen (7)"; 3273 [labelType="html" label="MapPartitionsRDD [3273] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8462 { label="Window"; 3274 [labelType="html" label="MapPartitionsRDD [3274] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8459 { label="WholeStageCodegen (8)"; 3275 [labelType="html" label="MapPartitionsRDD [3275] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8458 { label="DeserializeToObject"; 3276 [labelType="html" label="MapPartitionsRDD [3276] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8468 { label="mapPartitions"; 3278 [labelType="html" label="MapPartitionsRDD [3278] [Unordered]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8469 { label="map"; 3279 [labelType="html" label="MapPartitionsRDD [3279] [Unordered]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster8476 { label="WholeStageCodegen (1)"; 3284 [labelType="html" label="MapPartitionsRDD [3284] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster8475 { label="Coalesce"; 3285 [labelType="html" label="CoalescedRDD [3285] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster8474 { label="WriteFiles"; 3286 [labelType="html" label="MapPartitionsRDD [3286] [Unordered]<br>parquet at DataFrameParquetWriter.java:12"]; } } 3272->3273; 3273->3274; 3274->3275; 3275->3276; 3276->3277; 3277->3278; 3278->3279; 3279->3284; 3284->3285; 3285->3286; }
3271,3272
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time