3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 696 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
9.2 MiB / 138151
Output Size / Records:
8.8 MiB / 138151
Associated Job Ids:
355
DAG Visualization
digraph G { subgraph clusterstage_696 { label="Stage 696"; 3365 [labelType="html" label="SQLExecutionRDD [3365]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster8656 { label="Scan parquet "; 3361 [labelType="html" label="FileScanRDD [3361]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3362 [labelType="html" label="MapPartitionsRDD [3362]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8653 { label="WholeStageCodegen (1)"; 3363 [labelType="html" label="MapPartitionsRDD [3363]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8652 { label="DeserializeToObject"; 3364 [labelType="html" label="MapPartitionsRDD [3364]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8657 { label="mapPartitions"; 3366 [labelType="html" label="MapPartitionsRDD [3366]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8658 { label="map"; 3367 [labelType="html" label="MapPartitionsRDD [3367]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster8665 { label="WholeStageCodegen (1)"; 3372 [labelType="html" label="MapPartitionsRDD [3372]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster8664 { label="Coalesce"; 3373 [labelType="html" label="CoalescedRDD [3373]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster8663 { label="WriteFiles"; 3374 [labelType="html" label="MapPartitionsRDD [3374]<br>parquet at DataFrameParquetWriter.java:12"]; } } 3361->3362; 3362->3363; 3363->3364; 3364->3365; 3365->3366; 3366->3367; 3367->3372; 3372->3373; 3373->3374; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time