20 - Spark Table Interoperability¶
Wrangler has no difficults to insert, overwrite or do any other kind of interaction with a Table created by Apache Spark.
But if you want to do the oposite (Spark interacting with a table created by Wrangler) you should be aware that Wrangler follows the Hive’s format and you must be explicit when using the Spark’s saveAsTable
method:
[ ]:
spark_df.write.format("hive").saveAsTable("database.table")
Or just move forward using the insertInto
alternative:
[ ]:
spark_df.write.insertInto("database.table")