spark option emptyValue solved issue
val data2 = spark.read.option("header", "true") .option("inferSchema", "true") .option("treatEmptyValuesAsNulls","true") .option("nullValue", null)*** .option("emptyValue", null)*** .csv("file:///tmp/test.csv") Find centralized, trusted content and collaborate around the technologies you use most.
Learn more about CollectivesStack Internal
Knowledge at work
Bring the best of human thought and AI automation together at your work.
Explore Stack Internalspark option emptyValue solved issue
val data2 = spark.read.option("header", "true") .option("inferSchema", "true") .option("treatEmptyValuesAsNulls","true") .option("nullValue", null)*** .option("emptyValue", null)*** .csv("file:///tmp/test.csv") spark option emptyValue solved issue
val data2 = spark.read.option("header", "true").option("inferSchema", "true").option("treatEmptyValuesAsNulls","true").option("nullValue", null)***.option("emptyValue", null)***.csv("file:///tmp/test.csv") spark option emptyValue solved issue
val data2 = spark.read.option("header", "true") .option("inferSchema", "true") .option("treatEmptyValuesAsNulls","true") .option("nullValue", null)*** .option("emptyValue", null)*** .csv("file:///tmp/test.csv")