Description
The Custom Shell process is used for running a package that contains shell script and load their output to a dataset table.
Custom shell process enables users to run custom shell script in their environment(currently supports GCP)
Process Configuration
There are two screens that need configuring for this process type.
- Parameters
- Output
Parameters
-
- Package location
- ZIP file containing packages
- E.g : /dev/packages.zip
- Prediction file name
- Name for the custom script (E.g query_load.sh)
- Shell Script Arguments
- User defined variables
- Package location
Output
Output screen is where the table name can be defined along with the option to "Load to BQ" when using Google Cloud Platform.
Expected Output
Results from the script can be stored in Google BigQuery. By default, the results are loaded into Google Cloud Storage (refer Location in the Output configuration)