EVAL1_SPC1 - Details for Query 142

Submitted Time: 2026/06/03 08:05:27
Duration: 0.2 s
Succeeded Jobs: 316

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label="Execute InsertIntoHadoopFsRelationCommand task commit time: 1 ms number of written files: 1 job commit time: 10 ms number of output rows: 39 number of dynamic part: 0 written output: 3.0 KiB"]; 1 [labelType="html" label=" WriteFiles "]; subgraph cluster2 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 132 ms"; 3 [labelType="html" label=" Project "]; } 4 [labelType="html" label="BatchScan excel file:/data/input/depot/excel/execution/LOT_1_AIRFLOW_23177/current/LotMulti.xlsx number of output rows: 39"]; 1->0; 3->1; 4->3; }

Execute InsertIntoHadoopFsRelationCommand file:/data/input/depot/excel/cache/LOT_1_AIRFLOW_23177_2c5be5eaa69bd8af7f1fd714400db85e/LotMulti.xlsx_40cfe9508ec1cf1eed41330bc1c0e0a8, false, Parquet, [path=file:///data/input/depot/excel/cache/LOT_1_AIRFLOW_23177_2c5be5eaa69bd8af7f1fd714400db85e/LotMulti.xlsx_40cfe9508ec1cf1eed41330bc1c0e0a8], ErrorIfExists, [Numero+Lot, Time, Fr%C3%A9quence+%28s%29, Bioreactor+1+-+Air+flow, LOT_1_AIRFLOW_23177HEADER_COL_DETAIL_DEPOT]

WriteFiles

Project [Numero Lot#80383 AS Numero+Lot#80401, Time#80384, Fréquence (s)#80385 AS Fr%C3%A9quence+%28s%29#80413, Bioreactor 1 - Air flow#80386 AS Bioreactor+1+-+Air+flow#80419, file:/data/input/depot/excel/execution/LOT_1_AIRFLOW_23177/current/LotMulti.xlsx AS LOT_1_AIRFLOW_23177HEADER_COL_DETAIL_DEPOT#80425]

WholeStageCodegen (1)

BatchScan excel file:/data/input/depot/excel/execution/LOT_1_AIRFLOW_23177/current/LotMulti.xlsx[Numero Lot#80383, Time#80384, Fréquence (s)#80385, Bioreactor 1 - Air flow#80386] ExcelScan DataFilters: [], Format: excel, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/execution/LOT_1_AIRFLOW_23177/current/Lot..., PartitionFilters: [], ReadSchema: struct<Numero Lot:string,Time:string,Fréquence (s):string,Bioreactor 1 - Air flow:string>, PushedFilters: [] RuntimeFilters: []

Details

== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (4)
+- WriteFiles (3)
   +- * Project (2)
      +- BatchScan excel file:/data/input/depot/excel/execution/LOT_1_AIRFLOW_23177/current/LotMulti.xlsx (1)


(1) BatchScan excel file:/data/input/depot/excel/execution/LOT_1_AIRFLOW_23177/current/LotMulti.xlsx
Output [4]: [Numero Lot#80383, Time#80384, Fréquence (s)#80385, Bioreactor 1 - Air flow#80386]
Format: excel
Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/execution/LOT_1_AIRFLOW_23177/current/LotMulti.xlsx]
ReadSchema: struct<Numero Lot:string,Time:string,Fréquence (s):string,Bioreactor 1 - Air flow:string>

(2) Project [codegen id : 1]
Output [5]: [Numero Lot#80383 AS Numero+Lot#80401, Time#80384, Fréquence (s)#80385 AS Fr%C3%A9quence+%28s%29#80413, Bioreactor 1 - Air flow#80386 AS Bioreactor+1+-+Air+flow#80419, file:/data/input/depot/excel/execution/LOT_1_AIRFLOW_23177/current/LotMulti.xlsx AS LOT_1_AIRFLOW_23177HEADER_COL_DETAIL_DEPOT#80425]
Input [4]: [Numero Lot#80383, Time#80384, Fréquence (s)#80385, Bioreactor 1 - Air flow#80386]

(3) WriteFiles
Input [5]: [Numero+Lot#80401, Time#80384, Fr%C3%A9quence+%28s%29#80413, Bioreactor+1+-+Air+flow#80419, LOT_1_AIRFLOW_23177HEADER_COL_DETAIL_DEPOT#80425]

(4) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/input/depot/excel/cache/LOT_1_AIRFLOW_23177_2c5be5eaa69bd8af7f1fd714400db85e/LotMulti.xlsx_40cfe9508ec1cf1eed41330bc1c0e0a8, false, Parquet, [path=file:///data/input/depot/excel/cache/LOT_1_AIRFLOW_23177_2c5be5eaa69bd8af7f1fd714400db85e/LotMulti.xlsx_40cfe9508ec1cf1eed41330bc1c0e0a8], ErrorIfExists, [Numero+Lot, Time, Fr%C3%A9quence+%28s%29, Bioreactor+1+-+Air+flow, LOT_1_AIRFLOW_23177HEADER_COL_DETAIL_DEPOT]

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet