EVAL1_SPC1 - Details for Query 506

Submitted Time: 2026/02/20 11:39:28
Duration: 89 ms
Succeeded Jobs: 591

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label=" CollectLimit "]; subgraph cluster1 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 4 ms"; 2 [labelType="html" label=" Project "]; 3 [labelType="html" label="ColumnarToRow number of output rows: 82 number of input batches: 1"]; } 4 [labelType="html" label="Scan parquet number of files read: 1 scan time: 4 ms metadata time: 0 ms size of files read: 13.5 KiB number of output rows: 82"]; 2->0; 3->2; 4->3; }

CollectLimit 1500

Project [VISIT_ID_2942#64305 AS COL_VISIT_ID_2942#64428, PATIENT_ID_2943#64303 AS COL_PATIENT_ID_2943#64429, ID_SEJ_2944#64296 AS COL_ID_SEJ_2944#64430, ID_PAT_2945#64295 AS COL_ID_PAT_2945#64431, IN_DATE_2946#64297 AS COL_IN_DATE_2946#64432, OUT_DATE_2947#64300 AS COL_OUT_DATE_2947#64433, IN_MODE_2948#64298 AS COL_IN_MODE_2948#64434, OUT_MODE_2949#64301 AS COL_OUT_MODE_2949#64435, IN_UNIT_2950#64299 AS COL_IN_UNIT_2950#64436, OUT_UNIT_2951#64302 AS COL_OUT_UNIT_2951#64437, VISIT_TYPE_2952#64306 AS COL_VISIT_TYPE_2952#64438, CHAMP_PMSI_2953#64293 AS COL_CHAMP_PMSI_2953#64439, UNIT_PATH_2954#64304 AS COL_UNIT_PATH_2954#64440, staticinvoke(class org.apache.spark.sql.catalyst.util.CharVarcharCodegenUtils, StringType, readSidePadding, EMERGENCY_2955#64294, 1, true, false, true) AS COL_EMERGENCY_2955#64441, CANCELED_2956#64292 AS COL_CANCELED_2956#64442]

ColumnarToRow

WholeStageCodegen (1)

FileScan parquet [CANCELED_2956#64292,CHAMP_PMSI_2953#64293,EMERGENCY_2955#64294,ID_PAT_2945#64295,ID_SEJ_2944#64296,IN_DATE_2946#64297,IN_MODE_2948#64298,IN_UNIT_2950#64299,OUT_DATE_2947#64300,OUT_MODE_2949#64301,OUT_UNIT_2951#64302,PATIENT_ID_2943#64303,UNIT_PATH_2954#64304,VISIT_ID_2942#64305,VISIT_TYPE_2952#64306] Batched: true, DataFilters: [], Format: Parquet, Location: InMemoryFileIndex(1 paths)[file:/data/output/cache/parquet/uet/VISIT_2941], PartitionFilters: [], PushedFilters: [], ReadSchema: struct<CANCELED_2956:int,CHAMP_PMSI_2953:string,EMERGENCY_2955:string,ID_PAT_2945:int,ID_SEJ_2944...

Details

== Physical Plan ==
CollectLimit (4)
+- * Project (3)
   +- * ColumnarToRow (2)
      +- Scan parquet  (1)


(1) Scan parquet 
Output [15]: [CANCELED_2956#64292, CHAMP_PMSI_2953#64293, EMERGENCY_2955#64294, ID_PAT_2945#64295, ID_SEJ_2944#64296, IN_DATE_2946#64297, IN_MODE_2948#64298, IN_UNIT_2950#64299, OUT_DATE_2947#64300, OUT_MODE_2949#64301, OUT_UNIT_2951#64302, PATIENT_ID_2943#64303, UNIT_PATH_2954#64304, VISIT_ID_2942#64305, VISIT_TYPE_2952#64306]
Batched: true
Location: InMemoryFileIndex [file:/data/output/cache/parquet/uet/VISIT_2941]
ReadSchema: struct<CANCELED_2956:int,CHAMP_PMSI_2953:string,EMERGENCY_2955:string,ID_PAT_2945:int,ID_SEJ_2944:int,IN_DATE_2946:timestamp,IN_MODE_2948:string,IN_UNIT_2950:string,OUT_DATE_2947:timestamp,OUT_MODE_2949:string,OUT_UNIT_2951:string,PATIENT_ID_2943:string,UNIT_PATH_2954:string,VISIT_ID_2942:string,VISIT_TYPE_2952:string>

(2) ColumnarToRow [codegen id : 1]
Input [15]: [CANCELED_2956#64292, CHAMP_PMSI_2953#64293, EMERGENCY_2955#64294, ID_PAT_2945#64295, ID_SEJ_2944#64296, IN_DATE_2946#64297, IN_MODE_2948#64298, IN_UNIT_2950#64299, OUT_DATE_2947#64300, OUT_MODE_2949#64301, OUT_UNIT_2951#64302, PATIENT_ID_2943#64303, UNIT_PATH_2954#64304, VISIT_ID_2942#64305, VISIT_TYPE_2952#64306]

(3) Project [codegen id : 1]
Output [15]: [VISIT_ID_2942#64305 AS COL_VISIT_ID_2942#64428, PATIENT_ID_2943#64303 AS COL_PATIENT_ID_2943#64429, ID_SEJ_2944#64296 AS COL_ID_SEJ_2944#64430, ID_PAT_2945#64295 AS COL_ID_PAT_2945#64431, IN_DATE_2946#64297 AS COL_IN_DATE_2946#64432, OUT_DATE_2947#64300 AS COL_OUT_DATE_2947#64433, IN_MODE_2948#64298 AS COL_IN_MODE_2948#64434, OUT_MODE_2949#64301 AS COL_OUT_MODE_2949#64435, IN_UNIT_2950#64299 AS COL_IN_UNIT_2950#64436, OUT_UNIT_2951#64302 AS COL_OUT_UNIT_2951#64437, VISIT_TYPE_2952#64306 AS COL_VISIT_TYPE_2952#64438, CHAMP_PMSI_2953#64293 AS COL_CHAMP_PMSI_2953#64439, UNIT_PATH_2954#64304 AS COL_UNIT_PATH_2954#64440, staticinvoke(class org.apache.spark.sql.catalyst.util.CharVarcharCodegenUtils, StringType, readSidePadding, EMERGENCY_2955#64294, 1, true, false, true) AS COL_EMERGENCY_2955#64441, CANCELED_2956#64292 AS COL_CANCELED_2956#64442]
Input [15]: [CANCELED_2956#64292, CHAMP_PMSI_2953#64293, EMERGENCY_2955#64294, ID_PAT_2945#64295, ID_SEJ_2944#64296, IN_DATE_2946#64297, IN_MODE_2948#64298, IN_UNIT_2950#64299, OUT_DATE_2947#64300, OUT_MODE_2949#64301, OUT_UNIT_2951#64302, PATIENT_ID_2943#64303, UNIT_PATH_2954#64304, VISIT_ID_2942#64305, VISIT_TYPE_2952#64306]

(4) CollectLimit
Input [15]: [COL_VISIT_ID_2942#64428, COL_PATIENT_ID_2943#64429, COL_ID_SEJ_2944#64430, COL_ID_PAT_2945#64431, COL_IN_DATE_2946#64432, COL_OUT_DATE_2947#64433, COL_IN_MODE_2948#64434, COL_OUT_MODE_2949#64435, COL_IN_UNIT_2950#64436, COL_OUT_UNIT_2951#64437, COL_VISIT_TYPE_2952#64438, COL_CHAMP_PMSI_2953#64439, COL_UNIT_PATH_2954#64440, COL_EMERGENCY_2955#64441, COL_CANCELED_2956#64442]
Arguments: 1500

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet