3.5.7
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
EVAL1_SPC1
application UI
Details for Stage 375 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
2 s
Locality Level Summary:
Any: 3
Shuffle Read Size / Records:
4.1 MiB / 618009
Shuffle Write Size / Records:
172.3 KiB / 3
Associated Job Ids:
197
DAG Visualization
digraph G { subgraph clusterstage_375 { label="Stage 375"; subgraph cluster4843 { label="AQEShuffleRead"; 1929 [labelType="html" label="ShuffledRowRDD [1929] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4840 { label="WholeStageCodegen (16)"; 1930 [labelType="html" label="MapPartitionsRDD [1930] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4848 { label="AQEShuffleRead"; 1931 [labelType="html" label="ShuffledRowRDD [1931] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4845 { label="WholeStageCodegen (17)"; 1932 [labelType="html" label="MapPartitionsRDD [1932] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4836 { label="WholeStageCodegen (18)"; 1933 [labelType="html" label="ZippedPartitionsRDD2 [1933] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; 1934 [labelType="html" label="MapPartitionsRDD [1934] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4835 { label="ObjectHashAggregate"; 1935 [labelType="html" label="MapPartitionsRDD [1935] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } subgraph cluster4834 { label="Exchange"; 1936 [labelType="html" label="MapPartitionsRDD [1936] [Unordered]<br>takeAsList at DataFrameCommonJob.java:145"]; } } 1929->1930; 1931->1932; 1930->1933; 1932->1933; 1933->1934; 1934->1935; 1935->1936; }
1916,1929
1920,1931
Event Timeline
Enable zooming
Tasks: 3. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time