EVAL1_SPC1 - Details for Query 140

Submitted Time: 2026/06/03 08:05:26
Duration: 0.2 s
Succeeded Jobs: 313

Show the Stage ID and Task ID that corresponds to the max metric

digraph G { 0 [labelType="html" label="Execute InsertIntoHadoopFsRelationCommand task commit time: 1 ms number of written files: 1 job commit time: 10 ms number of output rows: 39 number of dynamic part: 0 written output: 3.0 KiB"]; 1 [labelType="html" label=" WriteFiles "]; subgraph cluster2 { isCluster="true"; label="WholeStageCodegen (1)\n \nduration: 108 ms"; 3 [labelType="html" label=" Project "]; } 4 [labelType="html" label="BatchScan excel file:/data/input/depot/excel/execution/LOT_2_AIRFLOW_23178/current/LotMulti.xlsx number of output rows: 39"]; 1->0; 3->1; 4->3; }

Execute InsertIntoHadoopFsRelationCommand file:/data/input/depot/excel/cache/LOT_2_AIRFLOW_23178_2510a9ac1b6232c54334baa16d570872/LotMulti.xlsx_6cfbc597fdbb92533bb751223cd8eb98, false, Parquet, [path=file:///data/input/depot/excel/cache/LOT_2_AIRFLOW_23178_2510a9ac1b6232c54334baa16d570872/LotMulti.xlsx_6cfbc597fdbb92533bb751223cd8eb98], ErrorIfExists, [Numero+Lot, Time, Fr%C3%A9quence+%28s%29, Bioreactor+1+-+Air+flow, LOT_2_AIRFLOW_23178HEADER_COL_DETAIL_DEPOT]

WriteFiles

Project [Numero Lot#80254 AS Numero+Lot#80272, Time#80255, Fréquence (s)#80256 AS Fr%C3%A9quence+%28s%29#80284, Bioreactor 1 - Air flow#80257 AS Bioreactor+1+-+Air+flow#80290, file:/data/input/depot/excel/execution/LOT_2_AIRFLOW_23178/current/LotMulti.xlsx AS LOT_2_AIRFLOW_23178HEADER_COL_DETAIL_DEPOT#80296]

WholeStageCodegen (1)

BatchScan excel file:/data/input/depot/excel/execution/LOT_2_AIRFLOW_23178/current/LotMulti.xlsx[Numero Lot#80254, Time#80255, Fréquence (s)#80256, Bioreactor 1 - Air flow#80257] ExcelScan DataFilters: [], Format: excel, Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/execution/LOT_2_AIRFLOW_23178/current/Lot..., PartitionFilters: [], ReadSchema: struct<Numero Lot:string,Time:string,Fréquence (s):string,Bioreactor 1 - Air flow:string>, PushedFilters: [] RuntimeFilters: []

Details

== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (4)
+- WriteFiles (3)
   +- * Project (2)
      +- BatchScan excel file:/data/input/depot/excel/execution/LOT_2_AIRFLOW_23178/current/LotMulti.xlsx (1)


(1) BatchScan excel file:/data/input/depot/excel/execution/LOT_2_AIRFLOW_23178/current/LotMulti.xlsx
Output [4]: [Numero Lot#80254, Time#80255, Fréquence (s)#80256, Bioreactor 1 - Air flow#80257]
Format: excel
Location: InMemoryFileIndex(1 paths)[file:/data/input/depot/excel/execution/LOT_2_AIRFLOW_23178/current/LotMulti.xlsx]
ReadSchema: struct<Numero Lot:string,Time:string,Fréquence (s):string,Bioreactor 1 - Air flow:string>

(2) Project [codegen id : 1]
Output [5]: [Numero Lot#80254 AS Numero+Lot#80272, Time#80255, Fréquence (s)#80256 AS Fr%C3%A9quence+%28s%29#80284, Bioreactor 1 - Air flow#80257 AS Bioreactor+1+-+Air+flow#80290, file:/data/input/depot/excel/execution/LOT_2_AIRFLOW_23178/current/LotMulti.xlsx AS LOT_2_AIRFLOW_23178HEADER_COL_DETAIL_DEPOT#80296]
Input [4]: [Numero Lot#80254, Time#80255, Fréquence (s)#80256, Bioreactor 1 - Air flow#80257]

(3) WriteFiles
Input [5]: [Numero+Lot#80272, Time#80255, Fr%C3%A9quence+%28s%29#80284, Bioreactor+1+-+Air+flow#80290, LOT_2_AIRFLOW_23178HEADER_COL_DETAIL_DEPOT#80296]

(4) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/input/depot/excel/cache/LOT_2_AIRFLOW_23178_2510a9ac1b6232c54334baa16d570872/LotMulti.xlsx_6cfbc597fdbb92533bb751223cd8eb98, false, Parquet, [path=file:///data/input/depot/excel/cache/LOT_2_AIRFLOW_23178_2510a9ac1b6232c54334baa16d570872/LotMulti.xlsx_6cfbc597fdbb92533bb751223cd8eb98], ErrorIfExists, [Numero+Lot, Time, Fr%C3%A9quence+%28s%29, Bioreactor+1+-+Air+flow, LOT_2_AIRFLOW_23178HEADER_COL_DETAIL_DEPOT]

SQL / DataFrame Properties

Name	Value
spark.sql.optimizer.nestedPredicatePushdown.supportedFileSources	parquet,orc,geoparquet