I'm looking to create a job that executes a production workflow that triggers each time a new file is loaded into a storage bucket. Can this be achieved as part of a job schedule? There appears to be a "file watcher" option, but this does not appear configurable.
Also, if the above can be configured with the file watcher, is there a parameter that I can leverage for the file name ( a bit like how "@InputTable1" refers to the input tables for Spark Processors / Transforms etc.)
Please sign in to leave a comment.