Spark Jdbc connection JDBCOptions

Question

I am trying to use the method savetable in the Spark JdbcUtils

The defination of the method is the following. It accepts the JDBCOptions as one of the parameter.

def saveTable( df: DataFrame, tableSchema: Option[StructType], isCaseSensitive: Boolean, options: JDBCOptions)

Following is the class of the JDBCOptions

While i am initializing the JDBCOptions with the url,transaction isolation level etc it is throwing errors.

Can you provide insights in initialization of the JDBCOptions

 val options :JDBCOptions = Map("url" -> "JDBCUrl") Error Type Map doesnt conform to be JDBCOption Type

How to initialize with correct type ?

Have a look here: docs.databricks.com/spark/latest/data-sources/… — Aydin K.
– Aydin K., Commented Feb 26, 2018 at 21:03
Or here (chapter „Running Jdbc to other Databases“): spark.apache.org/docs/latest/… — Aydin K.
– Aydin K., Commented Feb 26, 2018 at 21:04
@AydinK. I looked into them. They are using using Options but i am using the JDBCOptions. Both are different. — loneStar
– loneStar, Commented Feb 26, 2018 at 21:07

JoseM · Accepted Answer · 2018-02-26 21:47:28Z

You need to wrap the Map in a new JDBCOptions(...) call

// url and dbtable are required val options:JDBCOptions = new JDBCOptions(Map("url" -> "JDBCUrl", "dbtable" -> "foo"))

1 Answer 1