Snowflake

Instructions to work with Snowflake

Check a step-by-step tutorial at Towards Data Science.

The config value for the data and output attributes of the JSON is:

 "data" : [ {
			"name":"test", 
			"format":"net.snowflake.spark.snowflake", 
			"props": {
				"sfUrl": "rfa59271.snowflakecomputing.com",
				"sfUser": "sonalgoyal",
				"sfPassword":"ZZ",					
				"sfDatabase":"TEST",				
				"sfSchema":"PUBLIC",					
				"sfWarehouse":"COMPUTE_WH",
				"dbtable": "FEBRL",
				"application":"zingg_zingg"			
			}
		} ]

One must include Snowflake JDBC driver and Spark dependency on the classpath. The jars can be downloaded from the maven repository (1, 2).

For Zingg to discover the Snowflake jars, please add the property spark.jars in Zingg's runtime properties.

spark.jars=snowflake-jdbc-3.13.18.jar,spark-snowflake_2.12-2.10.0-spark_3.1.jar