3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 732 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Process local: 1
Input Size / Records:
9.2 MiB / 138151
Output Size / Records:
8.8 MiB / 138151
Associated Job Ids:
379
DAG Visualization
digraph G { subgraph clusterstage_732 { label="Stage 732"; 3488 [labelType="html" label="SQLExecutionRDD [3488]<br>toJavaRDD at AbsExportExecutor.java:55"]; subgraph cluster8923 { label="Scan parquet "; 3484 [labelType="html" label="FileScanRDD [3484]<br>toJavaRDD at AbsExportExecutor.java:55"]; 3485 [labelType="html" label="MapPartitionsRDD [3485]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8920 { label="WholeStageCodegen (1)"; 3486 [labelType="html" label="MapPartitionsRDD [3486]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8919 { label="DeserializeToObject"; 3487 [labelType="html" label="MapPartitionsRDD [3487]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8924 { label="mapPartitions"; 3489 [labelType="html" label="MapPartitionsRDD [3489]<br>toJavaRDD at AbsExportExecutor.java:55"]; } subgraph cluster8925 { label="map"; 3490 [labelType="html" label="MapPartitionsRDD [3490]<br>createDataFrame at AbsExportExecutor.java:55"]; } subgraph cluster8932 { label="WholeStageCodegen (1)"; 3495 [labelType="html" label="MapPartitionsRDD [3495]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster8931 { label="Coalesce"; 3496 [labelType="html" label="CoalescedRDD [3496]<br>parquet at DataFrameParquetWriter.java:12"]; } subgraph cluster8930 { label="WriteFiles"; 3497 [labelType="html" label="MapPartitionsRDD [3497]<br>parquet at DataFrameParquetWriter.java:12"]; } } 3484->3485; 3485->3486; 3486->3487; 3487->3488; 3488->3489; 3489->3490; 3490->3495; 3495->3496; 3496->3497; }
Event Timeline
Enable zooming
Tasks: 1. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time