Skip to main content

Return to Answer

Modified as per user's need
Source Link
edit approved Mar 13, 2020 at 10:16
whatsinthename
edit approved Mar 13, 2020 at 10:16
whatsinthename
  • 2.2k
  • 1
  • 30
  • 74

ChangeChanged the call to sc.read.schema(final_schema).text('/path') because text(...)text(...) will return a dataframe instance and you need to set schema before that.

Change the call to sc.read.schema(final_schema).text('/path') because text(...) will return a dataframe instance and you need to set schema before that.

Changed the call to sc.read.schema(final_schema).text('/path') because text(...) will return a dataframe instance and need to set schema before that.

Source Link
isha
isha
  • 153
  • 1
  • 1
  • 11

Change the call to sc.read.schema(final_schema).text('/path') because text(...) will return a dataframe instance and you need to set schema before that.