Setting GOOGLE_APPLICATION_CREDENTIALS environment variable in Scala

Question

I am running Spark-Shell with Scala and I want to set an environment variable to load data into Google bigQuery. The environment variable is GOOGLE_APPLICATION_CREDENTIALS and it contains /path/to/service/account.json

In python environment I can easily do,

import os os.environ['GOOGLE_APPLICATION_CREDENTIALS'] = "path/to/service/account.json"

However, I cannot do this in Scala. I can print out the system environment variables using,

scala> sys.env

or

scala> System.getenv()

which returns me a map of String Key,Value pairs. However,

scala> System.getenv("GOOGLE_APPLICATION_CREDENTIALS") = "path/to/service/account.json"

returns an error

<console>:26: error: value update is not a member of java.util.Map[String,String]

Possible duplicate of Scala: Unable to set environment variable — Brian McCutchon
– Brian McCutchon, Commented Jul 31, 2018 at 2:35

Regressor · Accepted Answer · 2018-07-30 20:52:09Z

I found a work around for this problem, though I dont think its the best practice. Here is the 2 step solution for this -

From terminal/cmd, first create the environment variable -

export GOOGLE_APPLICATION_CREDENTIALS=path/to/service/account.json
From the same terminal window, open spark-shell and run -

System.getenv("GOOGLE_APPLICATION_CREDENTIALS")

Collectives™ on Stack Overflow

Setting GOOGLE_APPLICATION_CREDENTIALS environment variable in Scala

1 Answer 1

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Linked

Related