A Source scenario must be run in order to produce any useful information. Each scenario run produces a collection of result sets. A result set is a group of related observations, usually from the same component and is usually, but not always, arranged as a time series.

During a run, each component in the scenario can produce one or more result sets in the form of predicted water flows, volumes and other outputs specific to that component. Some components are capable of producing more than 20 separate result sets. When ownership is not enabled, the model starts at the first node then progresses down the river system in a single pass to compute the water volume and flow rates through each node and link.

When ownership is enabled, the river system is modelled in two passes: an ordering phase and a flow distribution phase, and each phase can produce additional result sets.

Component-level controls

Whether any given result set is produced by any given run of a scenario is controlled by whether the result set’s recording parameter is enabled or disabled for that run. To adjust the state of recording parameters for a component, first select the component within the Project Hierarchy. Then do one of the following:

• To record all the available parameters for a component, right-click on the component and choose Record All from the contextual menu (Figure 154);
• To disable the recording of any parameters for a component, right-click on the component and choose Record None from the contextual menu (Figure 154); or
• To restore the model parameters for a component to their default value, right-click on the component and choose Set to Recording Defaults from the contextual menu (Figure 154).

Parameter-level controls

For fine-grained control of individual recordable parameters:

• Select the component within the Project Hierarchy. Selection causes all of the component’s parameters to be displayed in the Model Parameters area (Figure 155); and
• Use the contextual menu (right-click) to selectively enable or disable individual parameters or parameter groups, or to restore parameters to their default settings (Figure 155).

Scope of contextual menus

The contextual menus shown in Figure 154 and Figure 155 can be applied at any point within their respective hierarchical displays. If you select an individual component or parameter, the effect will be limited to just that element. Applying a choice at an aggregate level propagates the effect to the selected element and all elements below it in the hierarchy.

Setting recording defaults

Choosing Recording Defaults... from the View Type pop-up menu on the Project Explorer toolbar opens a window where you can specify the parameters which should be recorded by default for each kind of component. See also Recording Manager defaults. Changes made in this window persist across invocations of Source.

Running a Scenario

To run a scenario, do the following:

• Construct your scenario with the required nodes and links;
• Select the model outputs of interest. Some model outputs are selected by default; you can change which outputs are recorded by default;
• Click Select Analysis Type on the Simulation toolbar to set the appropriate type of analysis. Depending on the scenario, Source offers several options for analysing your model data, including:
• Flow calibration analysis, which derives the "best" set of parameter values so that output from the model matches an observed data set;
• Run w/Warm Up, which seeds the model with the available historical data and prepares for forecasting. See also Incorporating uncertainty into climate variability;
• Single analysis, which simulates the river performance for a single set of conditions (as opposed to an iterative analysis which considers several possible outcomes); or
• Stochastic analysis, which is used when dealing with stochastic climate data.

Other options may be added in future versions.

• Click Configure on the Simulation toolbar to select the required time frame for the scenario to run. The resulting window depends on the type of analysis you chose in the previous step. If you chose:
• Flow Calibration analysis, the Calibration Wizard opens. Refer to Calibration Wizard for catchments;
• Run w/Warm Up, the Run w/Warm Up window opens (#anchor-13-anchor);
• Single analysis, the Single Analysis window opens (Figure 156); or
• Stochastic analysis, the Stochastic Analysis Tool opens. Refer to Using the stochastic analysis tool.

You can only configure a run time frame that is supported by the time spans in the time series associated with your scenario. A lowest-common-denominator approach is used. For example, if your project contains two time series where the first spans the period 1/1/1900 through 31/12/1990, and the other the period 1/1/1960 through 21/12/2010, the available simulation time frame will be 1/1/1960 through 31/12/1990.

• Click Begin Analysis (Run) on the Simulation toolbar to start the simulation run.

While the scenario is running you will see a progress bar (Figure 157) displaying the percentage of the scenario completed, estimated time to completion and the current time step being processed.

Recording model outputs

When you run the models in a scenario, every node and link produces results in the form of predicted water flows, volumes and other data outputs.

Some node or link types can produce more than 20 separate data outputs (eg storages). In general, the more outputs you record, the longer the simulation will take, though this depends on exactly what you record; recording mass-balance is more computationally intensive than recording inflow, for example.

When you save a project, or make a copy of a scenario, Source automatically saves the list of model outputs selected for recording. There are two ways to select which parameters and model elements to record:

• Using the Project Explorer, right-click a node, link or other element in the Project Hierarchy or a model parameter (Figure 155). From the pop-up menu, select:
• Record all: every parameter at this level and below will be recorded;
• Record none: no parameters at this level and below will be recorded;

If the indicator appears as , this shows that some (not all) parameters at this level and below will be recorded.

• Using the Geographic Editor. If you select a model element on the Geographic Editor (eg a catchment outlet), then the chosen model element is highlighted in the Project Hierarchy. Right-click the element name and select the recording status from the pop-up menu, or click the Record icon in the Project Explorer toolbar.

Using the Log Reporter

If a scenario run results in errors or warnings, the first indication of those is displayed in the Run completion dialog by a red or yellow icon next to the Close button as indicated in Figure 159.

You can investigate the causes of errors or warnings using the Log reporter (Figure 160). If the Log Reporter window is not visible, do either or both of the following:

• Choose View > Log Reporter to make it visible; and
• Make the Log Reporter active by clicking the Log Reporter tab.

Once the Log Reporter is active, select the types of reports you want to view by clicking on one or more of the Errors, Warnings and Info buttons. To clear the log, right-click the Log Reporter window and choose Clear Log from the contextual menu. To copy log contents to the Windows clipboard, right-click the Log Reporter window and choose Copy Log from the contextual menu.

Scenario results

Each scenario run creates a distinct collection of result sets. Each collection is represented by a tab in the Recording Manager. The name of each tab is formed by concatenating the name of the scenario with a time-stamp indicating when the scenario was run. For example, Figure 161 shows that "Scenario 1" has been run twice at slightly different times.

You can use the tools on the Recording Manager toolbar to save a collection of results to a file, export a collection to Microsoft Excel, or delete the currently-selected collection.

Within each of the Recording Manager’s tabs, results are arranged in four columns:

• Type - Source generic name for node or link (eg Inflow);
• Name - your name for that component;
• Attribute - the name of the output parameter as listed in Parameters (eg Additional Inflow); and
• Values - a link which can be clicked to view a graphical representation of the output parameter.

You can navigate through a list of results using the vertical scroll bar. In addition, clicking on a link or node in the Schematic Editor or Project Hierarchy automatically selects all of the result sets associated with that component in the Recording Manager.

Right clicking in the Recording Manager, then choosing Save Selected allows you to export the selected time series data as a .csv file. Choosing View Selected opens the Charting Tool for the selected time series data.

One of the key uses of the Recording Manager is to select one or more result sets (rows in the Recording Manager) for display in the Charting Tool. The Charting Tool helps you visualise, analyse and understand time series and other data produced by Source. Each time you click a link in the Values column, a copy of the Charting Tool opens to display that result set. Clicking the same link multiple times opens additional copies of the Charting Tool containing the same result set.

You can also use the Chart Recording Manager to view and manage result sets. Refer to Chart Recording Manager for more information.

Determining the flow sequence

You can find out how flow travels through the model by enabling the Flow Sequence model parameter prior to running the model. Click on Miscellaneous in the Project Hierarchy, which will populate the Parameters list with various attributes. Right click on Flow Sequence and choose Record All from the contextual menu. This attribute can be viewed in the Recording Manager and lists the nodes and links which describe the flow sequence (from the Flow Distribution Phase) in the model run. You can export this list using the Export button as shown in Figure 162.

Incorporating uncertainty into climate variability

The Stochastic Analysis tool in Source is an abridged version of the Stochastic Climate Library (SCL) software available from the Catchment Modelling Toolkit web site, www.toolkit.net.au/scl. SCL is a stand-alone program containing several different stochastic models for climate data generation at various spatial and temporal scales.

The Source Stochastic Analysis tool currently contains a model for the generation of daily rainfall data for multiple sites using the transition probability matrix (with Boughton’s correction). Additional stochastic data generation models will be added to the Stochastic Analysis tool in the future. For a detailed description of the multi-site, daily rainfall generation model see Source Scientific Reference Guide.

Using the stochastic analysis tool

You must have an active scenario open in Source before you can use the Stochastic Analysis tool:

• In the Simulation toolbar, change the analysis option to Stochastic Analysis; and
• From the main toolbar, click Prepare to Run. The Stochastic Analysis window opens (Figure 163).

• Define the Start and End years;
• Specify the number of replicates to run. The default is 20;
• Click OK; and
• In the Simulation toolbar, click Run. The Stochastic Analysis tool will automatically load the rainfall data that is being used by the scenario, and then stochastically generate rainfall replicates for each sub-catchment.

The Stochastic Analysis tool may take some time to complete, depending on the number of sub-catchments, replicates, number of recorded variables and type of rainfall data used in the scenario. Generally, the more complex the model or scenario, the longer the stochastic generation of rainfall data will be.

To produce valid results when comparing statistics from the generated and historical data, the replicate length and the historical input data length must be the same. To properly capture sampling variability, you should also generate at least 100 replicates.

Once the Stochastic Analysis tool has finished, the modelled flow and constituent parameters appear in the Recording Manager and can be viewed by selecting the parameter of interest in the right-hand column of the Recording Manager.

A new screen appears with the stochastically generated flow and constituents replicates and statistical outputs (Figure 157).

All replicates are recorded and can be viewed by selecting a particular replicate, and this will be displayed as a time-series plot.

Viewing and assessing statistical results

A list of the possible Statistics is displayed in the top, middle window. To view a particular statistic, select one from the Statistics window. For example, the values of the statistic in the historical data, and the mean and percentiles of the statistic in the stochastically-generated data can be displayed as a box plot (Figure 165).

Limitations and cautionary notes

Although stochastic hydrology is a mature science, new stochastic models are continually being developed, usually with marginal improvements on previous models. The modelling approach for generating stochastic rainfall data has been selected because of available expertise, the model’s robustness, and extensive and successful model testing using data from across Australia.

A basic understanding of stochastic climate data is required to properly use stochastic data with hydrological and ecological models to quantify uncertainty in environmental systems associated with climate variability. The user should consider the following questions when designing a stochastic and hydrological modelling study: Is there a need for stochastic simulations? Is the hydrological model used for the particular application appropriate/reliable? Are the historical data reliable (note that stochastic data do not improve poor records, but improve the design made with whatever reliable historical records that are available)? Is the stochastic and hydrological modelling methodology appropriate? Do the statistics in the stochastically-generated climate data match those of the historical data?

The Stochastic Analysis tool can take a long time to run, particularly when applied to large catchments and when you have specified many replicates (ie over 100). Such applications can take several hours to run. Therefore, when first designing a scenario with stochastically-generated rainfall data, keep the following in mind:

• Perform a "dummy" run with only a few replicates (< 20) to assess whether or not the stochastically-generated data is being generated properly;
• Be specific about what you need to record. If the flow that is coming out of the catchment outlet is of particular interest, then only record the catchment outflow when using the Stochastic Analysis tool. All other parameters and reporting options can be set to "Record None". This will reduce the repeat run time and reduce the size of the generated output data; and
• Make note of how many years of data you want to generate climate data for. Although it is desirable to use as much data as possible, only use what you need to get a satisfactory model result.

As a general rule, the input data should have at least 20 years of historical climate time-series data.

Using the Tabular Editor

The Tabular Editor provides a spreadsheet-like representation of data that is otherwise presented in graphical form in the Recording Manager. The editor only contains information after a warm-up or scenario run and is positioned to the first time-step in the forecast period. Figure 166 has been adjusted slightly to show both historical and forecast data. The row where the cells have a pale blue background is the first day of the forecast period (ie, normally "today"). Rows prior to this show historical data. At this point, all values in the forecast period are zero because no forecasting has been done.

Clicking the column title opens the Charting Tool for the node’s time series. This is synonymous to right clicking and choosing Time Series Graph from the contextual menu (Figure 166). Choosing Feature Editor opens the node’s feature editor that is associated with that column. Additionally, the contextual menu provides a means of changing the column’s units and access to a formatting editor for the individual column (see Customising the Tabular Editor).

Clicking a cell shows the relationship between nodes corrected for travel time. Figure 166 shows this relationship using a yellow highlight. When multiple cells are selected:

• The travel-time indicator is only calculated for the last cell that was clicked; and
• The selection statistics are updated to show the sum and mean for all cells in the selection.

The Show Column Editor button expands the window (Figure 166) to include an hierarchical list of data sources that are candidates for inclusion in the Tabular Editor. Click Hide Column Editor to return to the original view.

Customising the Tabular Editor

You can customise the Tabular Editor to your needs. For each type of node or link, you can select:

• A background colour for the cell;
• A foreground colour and stylistic variation (eg bold-face) for values displayed in the cell; and
• The number of decimal places to be displayed.

There are two ways to apply formatting:

• By adjusting a set of user preferences. See Tabular Editor formatting. Changes made via this method apply to all projects; o
• By right-clicking a column heading and choosing Column Formatting (refer to Column Formatting) . Changes made via this method only apply to the current project.

Column Formatting

In this window, the Multiple Expressions tab allows you to apply conditional formatting to cells in the tabular editor to highlight when thresholds or rules are breached eg Flow < 500 ML/day. More than one expression can be applied to a cell. Click Add to specify the details of an expression, and Edit to define the expression using an Expression Editor. When more than one condition is satisfied, the cell is formatted as per the left hand side of the panel. Hover the mouse over the cell with the conditonal format, and the expression name is displayed. Click Remove to delete an expression from the list.

The Column Settings tab allows you to override project-related Tabular Editor Format Settings for the parameters displayed in the Tabular Editor.

The Header Settings tab allows you to create a header title (label) and header colour for the tabular editor.

Using the Column Editor

The Show Column Editor tab displays a tree view of all the nodes used in the scenario, which you can expand to show the output parameters for each node. You can change the way results are displayed in the Tabular Editor, making analysis easier. You can:

• Check or uncheck items in the list to show or hide the relevant columns in the table.
• Re-order columns by clicking and dragging an item to the desired location in the list. For example, Figure 170 shows how re-ordering the parameters in the list results in a re-arrangement of table columns. In this case, the Downstream Flow for Storage 2 and Storage 4 appear together in the table after re-ordering them in the column editor.

• Group similar parameters together using the group-related tabs. Click on Add Group and enter an appropriate name for the group. Add the desired parameters, nodes or links by clicking and dragging them into the new group. An additional group (Downstream flow volume for all inflows) has been added to the list in Figure 171, along with the relevant parameters from each inflow node. This group can be renamed (Edit Name) or removed (Del Group).

Identifying Constraints

When constraints are enforced, there may be a difference between the amount of water ordered and that released. The application of constraints is evident at both the Supply Point and Minimum Flow Requirement nodes.

To discover where constraints have been applied:

• Run the model;
• Select an appropriate Supply Point or Minimum Flow Requirement node. This selects all of the node’s recording parameters in the Recording Manager; and
• Inspect the Values column in the Recording Manager and click an Order Details link. This opens a Complex Time Series Form (Figure 172). The Graph tab provides a summary of the differences between the amount ordered and the amount released for the duration of the run. The Constraints column of the Table tab (Figure 173) provides a breakdown per time-step. Hover your mouse cursor over a cell of interest to see its contents presented in a tool-tip.