Need the equivalent of SQL IsNumeric function in spark sql

For anyone coming here by way of Google :) , there is an alternative answer by regex for isnumeric in spark sql

select OldColumn, CASE WHEN OldColumn not rlike '[^0-9]' THEN 1 ELSE 0 END AS OldColumnIsNumeric from table 

The regex simply checks if the column is numeric or not.

You can modify to fit for substrings of the column you are checking too.

Try using spark udf, this approach will help you clone any function -

scala> spark.udf.register("IsNumeric", (inpColumn: Int) => BigInt(inpColumn).isInstanceOf[BigInt]) res46: org.apache.spark.sql.expressions.UserDefinedFunction = UserDefinedFunction(<function1>,BooleanType,Some(List(IntegerType))) scala> spark.sql(s""" select "ABC", IsNumeric(123) as IsNumeric_1 """).show(false) +---+-----------+ |ABC|IsNumeric_1| +---+-----------+ |ABC|true | +---+-----------+ scala> spark.sql(s""" select "ABC", IsNumeric("ABC") as IsNumeric_1 """).show(false) +---+-----------+ |ABC|IsNumeric_1| +---+-----------+ |ABC|null | +---+-----------+ 

Here, above function will return null if column value is not integer.

Hope this will be helpful.