3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 975 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
24 s
Locality Level Summary:
Process local: 3
Input Size / Records:
9.8 MiB / 9522
Shuffle Write Size / Records:
171.0 B / 3
Associated Job Ids:
767
DAG Visualization
digraph G { subgraph clusterstage_975 { label="Stage 975"; subgraph cluster6607 { label="Scan parquet "; 2532 [labelType="html" label="FileScanRDD [2532]<br>count at ColumnStatJob.java:47"]; 2533 [labelType="html" label="MapPartitionsRDD [2533]<br>count at ColumnStatJob.java:47"]; } subgraph cluster6604 { label="WholeStageCodegen (1)"; 2534 [labelType="html" label="MapPartitionsRDD [2534]<br>count at ColumnStatJob.java:47"]; } subgraph cluster6603 { label="Filter"; 2535 [labelType="html" label="MapPartitionsRDD [2535]<br>count at ColumnStatJob.java:47"]; } subgraph cluster6602 { label="Project"; 2536 [labelType="html" label="MapPartitionsRDD [2536]<br>count at ColumnStatJob.java:47"]; } subgraph cluster6599 { label="WholeStageCodegen (2)"; 2537 [labelType="html" label="MapPartitionsRDD [2537]<br>count at ColumnStatJob.java:47"]; } subgraph cluster6598 { label="Filter"; 2538 [labelType="html" label="MapPartitionsRDD [2538]<br>count at ColumnStatJob.java:47"]; } subgraph cluster6594 { label="WholeStageCodegen (3)"; 2539 [labelType="html" label="MapPartitionsRDD [2539]<br>count at ColumnStatJob.java:47"]; } subgraph cluster6593 { label="Exchange"; 2540 [labelType="html" label="MapPartitionsRDD [2540]<br>count at ColumnStatJob.java:47"]; } } 2532->2533; 2533->2534; 2534->2535; 2535->2536; 2536->2537; 2537->2538; 2538->2539; 2539->2540; }
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time