digraph G {
0 [labelType="html" label="<b>Execute InsertIntoHadoopFsRelationCommand</b><br><br>task commit time: 1 ms<br>number of written files: 1<br>job commit time: 5 ms<br>number of output rows: 138,151<br>number of dynamic part: 0<br>written output: 8.8 MiB"];
1 [labelType="html" label="<br><b>WriteFiles</b><br><br>"];
2 [labelType="html" label="<br><b>Coalesce</b><br><br>"];
subgraph cluster3 {
isCluster="true";
label="WholeStageCodegen (1)\n \nduration: 1.9 s";
4 [labelType="html" label="<b>Scan ExistingRDD</b><br><br>number of output rows: 138,151"];
}
1->0;
2->1;
4->2;
}
5
Execute InsertIntoHadoopFsRelationCommand file:/data/output/export/parquet/980481d0-df6f-4c1c-82d0-1bdb9e1f2691, false, Parquet, [path=file:///data/output/export/parquet/980481d0-df6f-4c1c-82d0-1bdb9e1f2691], ErrorIfExists, [Identifiant-du-Patient, Nom-Usuel, Prenom, Nom-Naissance, Nationalite, Sexe, Civilite, ne-e--le, FINESS_ETAB, INSC, CODE-ETAB, NOM-ETAB, Annee-Naissance, rue, code-postal, commune, Latitude-Adresse, Longitude-Adresse, Departement, Chrono-Adresse-/-Patient, Cle-Id, Nb-d'addresse-Patient]
WriteFiles
Coalesce 1
Scan ExistingRDD[Identifiant-du-Patient#88595,Nom-Usuel#88596,Prenom#88597,Nom-Naissance#88598,Nationalite#88599,Sexe#88600,Civilite#88601,ne-e--le#88602,FINESS_ETAB#88603,INSC#88604,CODE-ETAB#88605,NOM-ETAB#88606,Annee-Naissance#88607,rue#88608,code-postal#88609,commune#88610,Latitude-Adresse#88611,Longitude-Adresse#88612,Departement#88613,Chrono-Adresse-/-Patient#88614,Cle-Id#88615,Nb-d'addresse-Patient#88616L]
WholeStageCodegen (1)
== Physical Plan ==
Execute InsertIntoHadoopFsRelationCommand (4)
+- WriteFiles (3)
+- Coalesce (2)
+- * Scan ExistingRDD (1)
(1) Scan ExistingRDD [codegen id : 1]
Output [22]: [Identifiant-du-Patient#88595, Nom-Usuel#88596, Prenom#88597, Nom-Naissance#88598, Nationalite#88599, Sexe#88600, Civilite#88601, ne-e--le#88602, FINESS_ETAB#88603, INSC#88604, CODE-ETAB#88605, NOM-ETAB#88606, Annee-Naissance#88607, rue#88608, code-postal#88609, commune#88610, Latitude-Adresse#88611, Longitude-Adresse#88612, Departement#88613, Chrono-Adresse-/-Patient#88614, Cle-Id#88615, Nb-d'addresse-Patient#88616L]
Arguments: [Identifiant-du-Patient#88595, Nom-Usuel#88596, Prenom#88597, Nom-Naissance#88598, Nationalite#88599, Sexe#88600, Civilite#88601, ne-e--le#88602, FINESS_ETAB#88603, INSC#88604, CODE-ETAB#88605, NOM-ETAB#88606, Annee-Naissance#88607, rue#88608, code-postal#88609, commune#88610, Latitude-Adresse#88611, Longitude-Adresse#88612, Departement#88613, Chrono-Adresse-/-Patient#88614, Cle-Id#88615, Nb-d'addresse-Patient#88616L], MapPartitionsRDD[3522] at createDataFrame at AbsExportExecutor.java:55, ExistingRDD, UnknownPartitioning(0)
(2) Coalesce
Input [22]: [Identifiant-du-Patient#88595, Nom-Usuel#88596, Prenom#88597, Nom-Naissance#88598, Nationalite#88599, Sexe#88600, Civilite#88601, ne-e--le#88602, FINESS_ETAB#88603, INSC#88604, CODE-ETAB#88605, NOM-ETAB#88606, Annee-Naissance#88607, rue#88608, code-postal#88609, commune#88610, Latitude-Adresse#88611, Longitude-Adresse#88612, Departement#88613, Chrono-Adresse-/-Patient#88614, Cle-Id#88615, Nb-d'addresse-Patient#88616L]
Arguments: 1
(3) WriteFiles
Input [22]: [Identifiant-du-Patient#88595, Nom-Usuel#88596, Prenom#88597, Nom-Naissance#88598, Nationalite#88599, Sexe#88600, Civilite#88601, ne-e--le#88602, FINESS_ETAB#88603, INSC#88604, CODE-ETAB#88605, NOM-ETAB#88606, Annee-Naissance#88607, rue#88608, code-postal#88609, commune#88610, Latitude-Adresse#88611, Longitude-Adresse#88612, Departement#88613, Chrono-Adresse-/-Patient#88614, Cle-Id#88615, Nb-d'addresse-Patient#88616L]
(4) Execute InsertIntoHadoopFsRelationCommand
Input: []
Arguments: file:/data/output/export/parquet/980481d0-df6f-4c1c-82d0-1bdb9e1f2691, false, Parquet, [path=file:///data/output/export/parquet/980481d0-df6f-4c1c-82d0-1bdb9e1f2691], ErrorIfExists, [Identifiant-du-Patient, Nom-Usuel, Prenom, Nom-Naissance, Nationalite, Sexe, Civilite, ne-e--le, FINESS_ETAB, INSC, CODE-ETAB, NOM-ETAB, Annee-Naissance, rue, code-postal, commune, Latitude-Adresse, Longitude-Adresse, Departement, Chrono-Adresse-/-Patient, Cle-Id, Nb-d'addresse-Patient]