digraph G {
0 [labelType="html" label="<b>Execute InsertIntoHadoopFsRelationCommand</b><br><br>task commit time: 1 ms<br>number of written files: 1<br>job commit time: 5 ms<br>number of output rows: 5,502<br>number of dynamic part: 0<br>written output: 91.9 KiB"];
1 [labelType="html" label="<br><b>WriteFiles</b><br><br>"];
2 [labelType="html" label="<br><b>Coalesce</b><br><br>"];
subgraph cluster3 {
isCluster="true";
label="WholeStageCodegen (1)\n \nduration: 1.5 s";
4 [labelType="html" label="<b>Scan ExistingRDD</b><br><br>number of output rows: 5,502"];
}
1->0;
2->1;
4->2;
}
5
Execute InsertIntoHadoopFsRelationCommand file:/data/output/export/parquet/5396e930-5715-4dab-8e81-765499e8dfa4, false, Parquet, [path=file:///data/output/export/parquet/5396e930-5715-4dab-8e81-765499e8dfa4], ErrorIfExists, [Identifiant-du-Patient, Nom-Usuel, Prenom, Nom-Naissance, Nationalite, Sexe, Civilite, ne-e--le, FINESS_ETAB, INSC, CODE-ETAB, NOM-ETAB, Annee-Naissance, Annee_To_int]
WriteFiles
Coalesce 1
Scan ExistingRDD[Identifiant-du-Patient#89251,Nom-Usuel#89252,Prenom#89253,Nom-Naissance#89254,Nationalite#89255,Sexe#89256,Civilite#89257,ne-e--le#89258,FINESS_ETAB#89259,INSC#89260,CODE-ETAB#89261,NOM-ETAB#89262,Annee-Naissance#89263,Annee_To_int#89264]
WholeStageCodegen (1)
== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (4)
+- WriteFiles (3)
+- Coalesce (2)
+- * Scan ExistingRDD (1)
(1) Scan ExistingRDD [codegen id : 1]
Output [14]: [Identifiant-du-Patient#89251, Nom-Usuel#89252, Prenom#89253, Nom-Naissance#89254, Nationalite#89255, Sexe#89256, Civilite#89257, ne-e--le#89258, FINESS_ETAB#89259, INSC#89260, CODE-ETAB#89261, NOM-ETAB#89262, Annee-Naissance#89263, Annee_To_int#89264]
Arguments: [Identifiant-du-Patient#89251, Nom-Usuel#89252, Prenom#89253, Nom-Naissance#89254, Nationalite#89255, Sexe#89256, Civilite#89257, ne-e--le#89258, FINESS_ETAB#89259, INSC#89260, CODE-ETAB#89261, NOM-ETAB#89262, Annee-Naissance#89263, Annee_To_int#89264], MapPartitionsRDD[3549] at createDataFrame at AbsExportExecutor.java:55, ExistingRDD, UnknownPartitioning(0)
(2) Coalesce
Input [14]: [Identifiant-du-Patient#89251, Nom-Usuel#89252, Prenom#89253, Nom-Naissance#89254, Nationalite#89255, Sexe#89256, Civilite#89257, ne-e--le#89258, FINESS_ETAB#89259, INSC#89260, CODE-ETAB#89261, NOM-ETAB#89262, Annee-Naissance#89263, Annee_To_int#89264]
Arguments: 1
(3) WriteFiles
Input [14]: [Identifiant-du-Patient#89251, Nom-Usuel#89252, Prenom#89253, Nom-Naissance#89254, Nationalite#89255, Sexe#89256, Civilite#89257, ne-e--le#89258, FINESS_ETAB#89259, INSC#89260, CODE-ETAB#89261, NOM-ETAB#89262, Annee-Naissance#89263, Annee_To_int#89264]
(4) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/export/parquet/5396e930-5715-4dab-8e81-765499e8dfa4, false, Parquet, [path=file:///data/output/export/parquet/5396e930-5715-4dab-8e81-765499e8dfa4], ErrorIfExists, [Identifiant-du-Patient, Nom-Usuel, Prenom, Nom-Naissance, Nationalite, Sexe, Civilite, ne-e--le, FINESS_ETAB, INSC, CODE-ETAB, NOM-ETAB, Annee-Naissance, Annee_To_int]