3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 736 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
9.2 MiB / 138151
Output Size / Records:
8.8 MiB / 138151
Associated Job Ids:
383
DAG Visualization
digraph G { subgraph clusterstage_736 { label="Stage 736"; 3520 [labelType="html" label="SQLExecutionRDD [3520]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster8983 { label="Scan parquet "; 3516 [labelType="html" label="FileScanRDD [3516]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3517 [labelType="html" label="MapPartitionsRDD [3517]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8980 { label="WholeStageCodegen (1)"; 3518 [labelType="html" label="MapPartitionsRDD [3518]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8979 { label="DeserializeToObject"; 3519 [labelType="html" label="MapPartitionsRDD [3519]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8984 { label="mapPartitions"; 3521 [labelType="html" label="MapPartitionsRDD [3521]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8985 { label="map"; 3522 [labelType="html" label="MapPartitionsRDD [3522]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster8992 { label="WholeStageCodegen (1)"; 3527 [labelType="html" label="MapPartitionsRDD [3527]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster8991 { label="Coalesce"; 3528 [labelType="html" label="CoalescedRDD [3528]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster8990 { label="WriteFiles"; 3529 [labelType="html" label="MapPartitionsRDD [3529]<br>parquet at DataFrameParquetWriter.java:12"]; } } 3516->3517; 3517->3518; 3518->3519; 3519->3520; 3520->3521; 3521->3522; 3522->3527; 3527->3528; 3528->3529; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time