What Spark defaults are we overriding (if any) during cluster instantiation?

Follow

Mike Z

March 02, 2022 19:05

I've heard that when we are instantiating a Spark cluster there may be some settings we are making that (for lack of better words) override Spark defaults. Are these documented somewhere? I'm most interested in EMR at this point, but will need to know if those differ from environment to environment.

0

• 

  Mahesh Shenoy July 29, 2022 09:01

  Mike Z was this question addressed offline? If you had identified, would be great if you could add it over here so that anyone else can refer later.

  Sarath Botlagunta / Shahdy Ali Hassan

  0

  Comment actions Permalink
• 

  Mahesh Shenoy November 17, 2022 09:03

  Sarath Botlagunta / Santhosh Maniyan : Please provide the information

  0

  Comment actions Permalink

Please sign in to leave a comment.