3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 992 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
25 s
Locality Level Summary:
Process local: 3
Input Size / Records:
10.0 MiB / 9522
Shuffle Write Size / Records:
3.5 MiB / 737
Associated Job Ids:
780
DAG Visualization
digraph G { subgraph clusterstage_992 { label="Stage 992"; subgraph cluster6792 { label="Scan parquet "; 2600 [labelType="html" label="FileScanRDD [2600]<br>takeAsList at DataFrameCommonJob.java:145"]; 2601 [labelType="html" label="MapPartitionsRDD [2601]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6789 { label="WholeStageCodegen (1)"; 2602 [labelType="html" label="MapPartitionsRDD [2602]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6788 { label="Filter"; 2603 [labelType="html" label="MapPartitionsRDD [2603]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6785 { label="WholeStageCodegen (2)"; 2604 [labelType="html" label="MapPartitionsRDD [2604]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6784 { label="Project"; 2605 [labelType="html" label="MapPartitionsRDD [2605]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6781 { label="WholeStageCodegen (3)"; 2606 [labelType="html" label="MapPartitionsRDD [2606]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6780 { label="Project"; 2607 [labelType="html" label="MapPartitionsRDD [2607]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6777 { label="WholeStageCodegen (4)"; 2608 [labelType="html" label="MapPartitionsRDD [2608]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster6776 { label="Exchange"; 2609 [labelType="html" label="MapPartitionsRDD [2609]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 2600->2601; 2601->2602; 2602->2603; 2603->2604; 2604->2605; 2605->2606; 2606->2607; 2607->2608; 2608->2609; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time