Operations - Activity Logs

The Operations screen is available within an app's Development and Production environment accessible via the clock icon ().  The operations screens provide details about job processing, ad-hoc and recurring, and the ability to modify job settings.

Activity Logs Grid

Within the Operations screen, clicking on an individual job card will display details of that job.  The Activity Logs tab shows various information and logs of the historical executions of the job.

The grid within Activity Logs shows one row per each instance of the job's execution.  The most recent execution is shown at the top, which is typically the most important instance an administrator is concerned with, but the historical executions are also seen and can be reviewed as needed.  The grid shows the following information:

Execution - The execution ID is a unique ID per execution of the job.  The IDs are unique within a single job, IDs are reused across jobs.  Every rerun of a job will produce a new execution ID.

Status - The Status column displays the current status of the job.  The far left column of the grid and the job card are also shown in each status's corresponding color.

• Starting (gray) - Job is in its initialization stages.
• Running (blue) - Job is actively running.
• Aborted (yellow) - Job has been aborted (manual intervention required to perform).
• Completed (green) - Job has completed successfully.
• Failed (red) - Job has completed with an error.

Start Time - The Start Time column displays the start date and time of the job.  The date format will be shown in the language of the browser.

End Time - The End Time column displays the end date and time of the job.  The date format will be shown in the language of the browser.

Duration (hh:mm:ss) - The Duration column displays the difference between Start Time and End Time if the job is concluded, i.e. Completed, Failed, or Aborted.  If the job is in the status Starting or Running then the Duration column displays the difference between Start Time and the user's computer current time.

Time Span - The Time Span column indicates the From Date and To Date parameter values the job was run with.

Type - The Type column indicates the method in which the job was started, i.e. Manual or Scheduled (only available in production).

Submitted By - The Submitted By column indicates the user that either submitted the job manually or last modified the job that ran on a scheduled basis.

Activity Log Grid Actions

Sorting - All columns can be sorted by clicking on the column header.  Clicking once results in the column to be sorted in ascending order, indicated by an up arrow (); a second click results in the column sorted in descending order, indicated by a down arrow (); a third click removes sorting on the column, indicated by no arrow.

Filtering - All columns can be filtered by clicking on the filter icon ().  The date columns, i.e. Start Time and End Time, can also be filtered directly by using using the calendar icon ().

View Logs - The logs at the job level can be seen by clicking the pop-up icon () seen within the status column (more detailed logs are also available at the individual step within a job, see below).  Within the Execution Logs window, the copy icon () can be clicked to copy the logs to the user's clipboard.

Execution Details - Clicking on an individual row within the Activity Logs grid brings up the Execution Details panel on the right side of the screen.  The panel summarizes the job information seen on the grid as well as provides details of each step within the job.

Details at the individual step level are especially useful when investigating execution times of a job, i.e. to see how much time each step of the entire job is taking, and execution logs for confirmation of specifics of the successfully completed steps and error messages of failed steps.

The top portion of the panel displays the same information at the job level as seen on the grid (see above).  In addition, if the job is running, an abort icon () will be shown next to the Duration field.  Clicking this icon will abort the currently running job.

The bottom portion of the Execution Details panel shows the following information for each step of the job.  It is important to note that each configured step, as seen in the Configure tab of the Operations screen of the job, regardless whether the step has run or not, will be displayed as well as cluster start-up and shutdown steps that are not shown in the configured steps of the job:

• Status Icon - The following icons are shown representing the status of each step:
  • Pending - The job has started, but the job step is pending; a blue pie chart icon is shown ().
  • Running - The job step is actively running; a blue rotating icon is shown ().
  • Aborted - The job step has been aborted (manual intervention required to perform); a yellow pause icon is shown ().
  • Not Started - The job has been aborted before attempting to run the configured step; a blank circle icon is shown ().
  • Completed - The job step has completed successfully; a green check icon is shown ().
  • Failed - The job step has completed with an error; a red exclamation mark is shown ().
• Name - The name of the individual step is shown in bold.
• Duration (hh:mm:ss) - The duration of the individual step is shown in the top right of the section.
• View Logs - The logs at the step level can be seen by clicking the pop-up icon () seen to the right of the duration.  Within the Execution Logs window, the copy icon () can be clicked to copy the logs to the user's clipboard.

• Start Time - The Start Time field displays the start date and time of the job step.  The date format will be shown in the language of the browser.  If the job step has not yet begun or the job was aborted and failed and thus a configured job step did not begin then the Start Time field will display N/A.
• End Time - The End Time field displays the end date and time of the job step.  The date format will be shown in the language of the browser.  If the job step is running or did not run because the job was aborted or a prior job step failed then the End Time field will display N/A.
• Process Mode - The Process Mode field displays the value of the setting at the time of the job step execution.  The process mode setting provides the app with instructions on how to handle the processing of incoming data, such as dropping any data or only processing new data.
• Runtime Type - Seen by expanding the details of the job step, the Runtime Type field displays the type of the runtime that this step was run on.
• Runtime - Seen by expanding the details of the job step, the Runtime field displays the individual runtime that this step was run on.