Drop column within function sparkR

Question

Say I want to write a function to delete a column from a SparkR DataFrame(Version 1.6.0):

dropColumn <- function(df, col) { df[[col]] <- NULL df } df <- dropColumn(df, 'Email')

But it would error out:

Error in `[[<-`(`*tmp*`, col, value = NULL) : [[<- defined for objects of type "S4" only for subclasses of environment

How can I change my code fix it?

I mean there is not much you can do about it here. DataFrame simply doesn't implement [[<-. — zero323
– zero323, Commented Feb 29, 2016 at 22:53

xyzzy · Accepted Answer · 2016-03-01 00:10:53Z

There's currently no convenience method in dataframe for dropping a column. I think this would work for now until it could could be implemented in SparkR:

dropColumn <- function(df, col) { tempdf <- new("DataFrame", sdf=SparkR:::callJMethod(df@sdf, "drop", col), isCached=FALSE) tempdf } newdf <- dropColumn(inputdf, 'Email')

Collectives™ on Stack Overflow

Drop column within function sparkR

1 Answer 1

Comments

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Related