How do I increase my Spark cluster boot disk size?

Completed

Mike Z

February 26, 2022 17:46

I'm running into out of disk space errors on my cluster. How do I increase the boot disk size?

0

Comments

1 comment

Mike Z February 26, 2022 17:52
To increase the boot disk size for your Spark cluster you need to add the below "Config Setting" to your runtime and specify a value.
```
syntasa.runtime.boot.disk.size
```
By default the Syntasa sets the Spark cluster boot disk size to 30GB, you can typically safely get by with setting the boot disk size to 100. Please see screenshot for how the setting looks in the runtime.
0

Comment actions Permalink

Please sign in to leave a comment.