EVAL1_SPC1 - Details for Query 695

Submitted Time: 2026/02/20 13:27:38
Duration: 94 ms
Succeeded Jobs: 855

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" CollectLimit "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 7 ms"; 2 [labelType="html" label=" Project "]; 3 [labelType="html" label="ColumnarToRow number of output rows: 717 number of input batches: 1"]; } 4 [labelType="html" label="Scan parquet number of files read: 1 scan time: 4 ms metadata time: 0 ms size of files read: 63.4 KiB number of output rows: 717"]; 2->0; 3->2; 4->3; }

CollectLimit 1500

Project [VISIT_ID_3343#106254 AS COL_VISIT_ID_3343#106361, PATIENT_ID_3344#106252 AS COL_PATIENT_ID_3344#106362, IN_DATE_3345#106246 AS COL_IN_DATE_3345#106363, OUT_DATE_3346#106249 AS COL_OUT_DATE_3346#106364, IN_MODE_3347#106247 AS COL_IN_MODE_3347#106365, OUT_MODE_3348#106250 AS COL_OUT_MODE_3348#106366, IN_UNIT_3349#106248 AS COL_IN_UNIT_3349#106367, OUT_UNIT_3350#106251 AS COL_OUT_UNIT_3350#106368, VISIT_TYPE_3351#106255 AS COL_VISIT_TYPE_3351#106369, CHAMP_PMSI_3352#106244 AS COL_CHAMP_PMSI_3352#106370, UNIT_PATH_3353#106253 AS COL_UNIT_PATH_3353#106371, staticinvoke(class org.apache.spark.sql.catalyst.util.CharVarcharCodegenUtils, StringType, readSidePadding, EMERGENCY_3354#106245, 1, true, false, true) AS COL_EMERGENCY_3354#106372, CANCELED_3355#106243 AS COL_CANCELED_3355#106373]

ColumnarToRow

WholeStageCodegen (1)

FileScan parquet [CANCELED_3355#106243,CHAMP_PMSI_3352#106244,EMERGENCY_3354#106245,IN_DATE_3345#106246,IN_MODE_3347#106247,IN_UNIT_3349#106248,OUT_DATE_3346#106249,OUT_MODE_3348#106250,OUT_UNIT_3350#106251,PATIENT_ID_3344#106252,UNIT_PATH_3353#106253,VISIT_ID_3343#106254,VISIT_TYPE_3351#106255] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/uet/VISIT_3342], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<CANCELED_3355:int,CHAMP_PMSI_3352:string,EMERGENCY_3354:string,IN_DATE_3345:timestamp,IN_M...

Details

== Physical Plan ==
CollectLimit (4)
+- * Project (3)
   +- * ColumnarToRow (2)
      +- Scan parquet  (1)


(1) Scan parquet 
Output [13]: [CANCELED_3355#106243, CHAMP_PMSI_3352#106244, EMERGENCY_3354#106245, IN_DATE_3345#106246, IN_MODE_3347#106247, IN_UNIT_3349#106248, OUT_DATE_3346#106249, OUT_MODE_3348#106250, OUT_UNIT_3350#106251, PATIENT_ID_3344#106252, UNIT_PATH_3353#106253, VISIT_ID_3343#106254, VISIT_TYPE_3351#106255]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/uet/VISIT_3342]
ReadSchema: struct<CANCELED_3355:int,CHAMP_PMSI_3352:string,EMERGENCY_3354:string,IN_DATE_3345:timestamp,IN_MODE_3347:string,IN_UNIT_3349:string,OUT_DATE_3346:timestamp,OUT_MODE_3348:string,OUT_UNIT_3350:string,PATIENT_ID_3344:string,UNIT_PATH_3353:string,VISIT_ID_3343:string,VISIT_TYPE_3351:string>

(2) ColumnarToRow [codegen id : 1]
Input [13]: [CANCELED_3355#106243, CHAMP_PMSI_3352#106244, EMERGENCY_3354#106245, IN_DATE_3345#106246, IN_MODE_3347#106247, IN_UNIT_3349#106248, OUT_DATE_3346#106249, OUT_MODE_3348#106250, OUT_UNIT_3350#106251, PATIENT_ID_3344#106252, UNIT_PATH_3353#106253, VISIT_ID_3343#106254, VISIT_TYPE_3351#106255]

(3) Project [codegen id : 1]
Output [13]: [VISIT_ID_3343#106254 AS COL_VISIT_ID_3343#106361, PATIENT_ID_3344#106252 AS COL_PATIENT_ID_3344#106362, IN_DATE_3345#106246 AS COL_IN_DATE_3345#106363, OUT_DATE_3346#106249 AS COL_OUT_DATE_3346#106364, IN_MODE_3347#106247 AS COL_IN_MODE_3347#106365, OUT_MODE_3348#106250 AS COL_OUT_MODE_3348#106366, IN_UNIT_3349#106248 AS COL_IN_UNIT_3349#106367, OUT_UNIT_3350#106251 AS COL_OUT_UNIT_3350#106368, VISIT_TYPE_3351#106255 AS COL_VISIT_TYPE_3351#106369, CHAMP_PMSI_3352#106244 AS COL_CHAMP_PMSI_3352#106370, UNIT_PATH_3353#106253 AS COL_UNIT_PATH_3353#106371, staticinvoke(class org.apache.spark.sql.catalyst.util.CharVarcharCodegenUtils, StringType, readSidePadding, EMERGENCY_3354#106245, 1, true, false, true) AS COL_EMERGENCY_3354#106372, CANCELED_3355#106243 AS COL_CANCELED_3355#106373]
Input [13]: [CANCELED_3355#106243, CHAMP_PMSI_3352#106244, EMERGENCY_3354#106245, IN_DATE_3345#106246, IN_MODE_3347#106247, IN_UNIT_3349#106248, OUT_DATE_3346#106249, OUT_MODE_3348#106250, OUT_UNIT_3350#106251, PATIENT_ID_3344#106252, UNIT_PATH_3353#106253, VISIT_ID_3343#106254, VISIT_TYPE_3351#106255]

(4) CollectLimit
Input [13]: [COL_VISIT_ID_3343#106361, COL_PATIENT_ID_3344#106362, COL_IN_DATE_3345#106363, COL_OUT_DATE_3346#106364, COL_IN_MODE_3347#106365, COL_OUT_MODE_3348#106366, COL_IN_UNIT_3349#106367, COL_OUT_UNIT_3350#106368, COL_VISIT_TYPE_3351#106369, COL_CHAMP_PMSI_3352#106370, COL_UNIT_PATH_3353#106371, COL_EMERGENCY_3354#106372, COL_CANCELED_3355#106373]
Arguments: 1500

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet