RS AWS - Spark code is not picking up table

Follow

Joseph O'Shea

May 23, 2022 15:41

When converting the BQ process to spark, the spark code is not picking up the previous tables even though they exist in hive.

In prod it complains about not finding the column for the alert.
I broke up the SQL in the dev workflow which is where its reporting the missing table. I have no idea why the table is not being picked up.

0

• 

  Joseph O'Shea May 23, 2022 15:47

  https://10.245.58.37/apps/d7dfe698-3950-405f-8168-09b2b3053398/production/operations/e01c0efd-00d9-4ab9-8088-cb2364408764?tab=activity-logs

  0

  Comment actions Permalink
• 

  Mahesh Shenoy July 29, 2022 05:32

  Joseph O'Shea :  was this addressed and is still an issue 

  Sarath Botlagunta / Shahdy Ali Hassan

  0

  Comment actions Permalink

Please sign in to leave a comment.