data science team / dsquality

Download as
Browse Code »

Commit dc44f2e39ce46fdde4acba44909cb941c2cedfe2

Authored by 박용규 ago
1 parent 9290e3c54c
Exists in master

add parquet file write mode(Overwrite) option

Showing 1 changed file with 1 additions and 1 deletions Side-by-side Diff

app/com/piki_ds/preprocess/HourlyCommentCnt.scala View file @ dc44f2e
... ... @@ -166,7 +166,7 @@
166 166 }
167 167 }.coalesce(1)
168 168 val byHourDF = sqlContext.createDataFrame(byHourFmt,schema)
169   - byHourDF.write.parquet(filepath)
  169 + byHourDF.write.mode(SaveMode.Overwrite).parquet(filepath)
170 170 })
171 171 }
172 172