Comments

5 comments

  • Avatar
    Arjun Sasikumar

    It is pretty much same as daily partition except that we need to format the partition column in YYYY-MM-DD-HH manner. Also in the configuration of the output, select Hourly instead of Daily  

    0
    Comment actions Permalink
  • Avatar
    Labinot Dvorani

    Arjun Sasikumar Can you show us  sample app, I understand partitioning it if the input is already hourly but what if the input is partitioned daily and in the next step we want to do hourly partitioning.

    0
    Comment actions Permalink
  • Avatar
    Arjun Sasikumar

    We currently don't have such an example where we change daily partition to hourly. There just needs to be a column where we can get the hourly data to partition

    0
    Comment actions Permalink
  • Avatar
    Mahesh Shenoy

    Labinot Dvorani : were you able to get a sample app for this. Else Arjun Sasikumar can you please create a sample app?

    0
    Comment actions Permalink
  • Avatar
    Labinot Dvorani

    in 7.1.2 hourly partitioning has been added to BQ process, while it's already possible to partition hourly using the spark process. 

    0
    Comment actions Permalink

Please sign in to leave a comment.