输出csv而不是snappy.parquet

我正在运行下面的代码:

  for x in days:
       for i in numbers:
           mega_query = spark.sql("select *  " \
                        "from db.table " \
                        "where date ={} " \
                        "and number = {} ".format(x, 1))

     
 
  mega_query.write.mode('append').options(header='true').save("/path/results2.csv")

我想在最后有一个csv文件,但是我有很多snappy.parquet文件。如何使用结果仅创建一个csv?

转载请注明出处:http://www.cjhyc.com/article/20230601/2189389.html