How to set configuration values in SparkContext?

Asked Dec 15 '15 at 19:06

Active Dec 15 '15 at 22:34

Viewed 153 times

I have an object of type SQLContext. I know I can use setConf to set a configuration value for it, but if I want to set a configuration value for sqlContext.sparkContext, it doesn't have a setConf function available to set a value. So this doesn't work.

sqlContext.setConf("spark.driver.maxResultSize", "2048")

Not sure how to do this.

asked Dec 15 '15 at 19:06

aa8y

3,854
4
37
62

You can simply pass `SparkConf` object to the context constructor. – zero323 Dec 15 '15 at 22:12
What if I already have a `SQLContext` provided to me by Spark Job Server? I just want to modify it. – aa8y Dec 15 '15 at 22:16

How to set configuration values in SparkContext?

0 Answers0