digraph G {
0 [labelType="html" label="<br><b>AdaptiveSparkPlan</b><br><br>"];
1 [labelType="html" label="<b>Execute InsertIntoHadoopFsRelationCommand</b><br><br>task commit time: 12 ms<br>number of written files: 1<br>job commit time: 21 ms<br>number of output rows: 609<br>number of dynamic part: 0<br>written output: 144.1 KiB"];
2 [labelType="html" label="<br><b>WriteFiles</b><br><br>"];
3 [labelType="html" label="<b>Exchange</b><br><br>shuffle records written: 609<br>local merged chunks fetched: 0<br>shuffle write time: 18 ms<br>remote merged bytes read: 0.0 B<br>local merged blocks fetched: 0<br>corrupt merged block chunks: 0<br>remote merged reqs duration: 0 ms<br>remote merged blocks fetched: 0<br>records read: 609<br>local bytes read: 52.3 KiB<br>fetch wait time: 0 ms<br>remote bytes read: 0.0 B<br>merged fetch fallback count: 0<br>local blocks read: 1<br>remote merged chunks fetched: 0<br>remote blocks read: 0<br>data size: 223.7 KiB<br>local merged bytes read: 0.0 B<br>number of partitions: 1<br>remote reqs duration: 0 ms<br>remote bytes read to disk: 0.0 B<br>shuffle bytes written: 52.3 KiB"];
subgraph cluster4 {
isCluster="true";
label="WholeStageCodegen (1)\n \nduration: 289 ms";
5 [labelType="html" label="<b>Scan ExistingRDD</b><br><br>number of output rows: 609"];
}
1->0;
2->1;
3->2;
5->3;
}
6
AdaptiveSparkPlan isFinalPlan=true
Execute InsertIntoHadoopFsRelationCommand file:/data/output/export/csv/4172d8e6-6ee3-4434-85dc-1ead04e93b19, false, CSV, [path=file:///data/output/export/csv/4172d8e6-6ee3-4434-85dc-1ead04e93b19, nullValue=, ignoreLeadingWhiteSpace=true, quoteAll=false, sep=;, quote=", emptyValue=, ignoreTrailingWhiteSpace=true, escape=\, charset=UTF-8, lineSep=
, header=true], ErrorIfExists, [N_Courrier, IPP, IEP, Type_Origine, Type_Courrier, Date_Courrier, Auteur, Specialite_Executant, Statut_Courrier, Destinataire, Mots_Cles, Fichier_Courrier]
WriteFiles
Exchange SinglePartition, REPARTITION_BY_NUM, [plan_id=69]
Scan ExistingRDD[N_Courrier#284,IPP#285,IEP#286,Type_Origine#287,Type_Courrier#288,Date_Courrier#289,Auteur#290,Specialite_Executant#291,Statut_Courrier#292,Destinataire#293,Mots_Cles#294,Fichier_Courrier#295]
WholeStageCodegen (1)
== Physical Plan ==
AdaptiveSparkPlan (9)
+- == Final Plan ==
Execute InsertIntoHadoopFsRelationCommand (5)
+- WriteFiles (4)
+- ShuffleQueryStage (3), Statistics(sizeInBytes=223.7 KiB, rowCount=609)
+- Exchange (2)
+- * Scan ExistingRDD (1)
+- == Initial Plan ==
Execute InsertIntoHadoopFsRelationCommand (8)
+- WriteFiles (7)
+- Exchange (6)
+- Scan ExistingRDD (1)
(1) Scan ExistingRDD [codegen id : 1]
Output [12]: [N_Courrier#284, IPP#285, IEP#286, Type_Origine#287, Type_Courrier#288, Date_Courrier#289, Auteur#290, Specialite_Executant#291, Statut_Courrier#292, Destinataire#293, Mots_Cles#294, Fichier_Courrier#295]
Arguments: [N_Courrier#284, IPP#285, IEP#286, Type_Origine#287, Type_Courrier#288, Date_Courrier#289, Auteur#290, Specialite_Executant#291, Statut_Courrier#292, Destinataire#293, Mots_Cles#294, Fichier_Courrier#295], MapPartitionsRDD[16] at createDataFrame at AbsExportExecutor.java:55, ExistingRDD, UnknownPartitioning(0)
(2) Exchange
Input [12]: [N_Courrier#284, IPP#285, IEP#286, Type_Origine#287, Type_Courrier#288, Date_Courrier#289, Auteur#290, Specialite_Executant#291, Statut_Courrier#292, Destinataire#293, Mots_Cles#294, Fichier_Courrier#295]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=69]
(3) ShuffleQueryStage
Output [12]: [N_Courrier#284, IPP#285, IEP#286, Type_Origine#287, Type_Courrier#288, Date_Courrier#289, Auteur#290, Specialite_Executant#291, Statut_Courrier#292, Destinataire#293, Mots_Cles#294, Fichier_Courrier#295]
Arguments: 0
(4) WriteFiles
Input [12]: [N_Courrier#284, IPP#285, IEP#286, Type_Origine#287, Type_Courrier#288, Date_Courrier#289, Auteur#290, Specialite_Executant#291, Statut_Courrier#292, Destinataire#293, Mots_Cles#294, Fichier_Courrier#295]
(5) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/export/csv/4172d8e6-6ee3-4434-85dc-1ead04e93b19, false, CSV, [path=file:///data/output/export/csv/4172d8e6-6ee3-4434-85dc-1ead04e93b19, nullValue=, ignoreLeadingWhiteSpace=true, quoteAll=false, sep=;, quote=", emptyValue=, ignoreTrailingWhiteSpace=true, escape=\, charset=UTF-8, lineSep=
, header=true], ErrorIfExists, [N_Courrier, IPP, IEP, Type_Origine, Type_Courrier, Date_Courrier, Auteur, Specialite_Executant, Statut_Courrier, Destinataire, Mots_Cles, Fichier_Courrier]
(6) Exchange
Input [12]: [N_Courrier#284, IPP#285, IEP#286, Type_Origine#287, Type_Courrier#288, Date_Courrier#289, Auteur#290, Specialite_Executant#291, Statut_Courrier#292, Destinataire#293, Mots_Cles#294, Fichier_Courrier#295]
Arguments: SinglePartition, REPARTITION_BY_NUM, [plan_id=62]
(7) WriteFiles
Input [12]: [N_Courrier#284, IPP#285, IEP#286, Type_Origine#287, Type_Courrier#288, Date_Courrier#289, Auteur#290, Specialite_Executant#291, Statut_Courrier#292, Destinataire#293, Mots_Cles#294, Fichier_Courrier#295]
(8) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/export/csv/4172d8e6-6ee3-4434-85dc-1ead04e93b19, false, CSV, [path=file:///data/output/export/csv/4172d8e6-6ee3-4434-85dc-1ead04e93b19, nullValue=, ignoreLeadingWhiteSpace=true, quoteAll=false, sep=;, quote=", emptyValue=, ignoreTrailingWhiteSpace=true, escape=\, charset=UTF-8, lineSep=
, header=true], ErrorIfExists, [N_Courrier, IPP, IEP, Type_Origine, Type_Courrier, Date_Courrier, Auteur, Specialite_Executant, Statut_Courrier, Destinataire, Mots_Cles, Fichier_Courrier]
(9) AdaptiveSparkPlan
Output: []
Arguments: isFinalPlan=true