Introduction
A Source scenario must be run in order to produce any useful information. Each scenario run produces a collection of result sets. A result set is a group of related outputs, usually from the same component and is usually, but not always, arranged as a time series.
During a run, each component in the scenario can produce one or more result sets in the form of predicted water flows, volumes and other outputs specific to that component. Some components are capable of producing more than 20 separate result sets. When ownership is not enabled, the model starts at the first node then progresses down the river system in a single pass to compute the water volume and flow rates through each node and link.
Figure 1. Selecting recording parameters
Running a
...
scenario
To run a scenario, do the following:
- Select the model outputs of interest. Some model outputs are selected by default; you can change which outputs are recorded by default;
- Click Select Analysis Type on the Simulation toolbar to set the appropriate type of analysis. Depending on the scenario, Source offers several options for analysing your model data, including:
- Flow calibration analysis, which calibrates a set of rainfall-runoff and flow routing model parameter values so that output from the model is representative of an observed data set;
- Run w/Warm Up, which seeds the model with the available historical data and prepares for forecasting. This is enabled in River Operations scenarios only;
- Single analysis, which simulates the river performance for a single set of conditions (as opposed to an iterative analysis which considers several possible outcomes); or
- Stochastic analysis, which is used to generate flow replicates from stochastically generated rainfall inputs when dealing with stochastic climate data. See also Incorporating uncertainty into climate variability.
- Click Configure on the Simulation toolbar to select the required time frame for the scenario to run. The resulting window depends on the type of analysis you chose in the previous step. If you chose:
- Flow Calibration analysis, the Calibration Wizard opens. Refer to Calibration Wizard for catchments;
- Run w/Warm Up, the Run w/Warm Up window opens (
...
- Run w/Warm up);
- Single analysis, the Single Analysis window opens (Figure 2); or
- Stochastic analysis, the Stochastic Analysis Tool opens. Refer to Using the stochastic analysis tool.
You can only configure a run time frame that is supported by the time spans in the time series associated with your scenario. A lowest-common-denominator approach is used. For example, if your project contains two time series where the first spans the period 1/1/1900 through 31/12/1990, and the other the period 1/1/1960 through 21/12/2010, the available simulation time frame will be 1/1/1960 through 31/12/1990.
- Click Begin Analysis (Run) on the Simulation toolbar to start the simulation run.
Figure 2. Configure single analysis
While the scenario is running, you will see a progress bar (Figure 3) displaying the percentage of the scenario completed, estimated time to completion and the current time-step being processed.
Figure 3. Running scenario (progress bar)
Component-level controls
Whether any given result set is produced by any given run of a scenario is controlled by whether the result set’s recording parameter is enabled or disabled for that run. To adjust the state of recording parameters for a component, first select the component within the
...
Project Hierarchy. Then do one of the following:
- To record all the available parameters for a component, right-click on the component and choose Record All from the contextual menu (Figure 1);
- To disable the recording of any parameters for a component, right-click on the component and choose Record None from the contextual menu (Figure 1); or
- To restore the model parameters for a component to their default value, right-click on the component and choose Set to Recording Defaults from the contextual menu (Figure 1).
Parameter-level controls
- Select the component within the Project Hierarchy. Selection causes all of the component’s parameters to be displayed in the
...
- Model Parameters area (Figure 4); and
- Use the contextual menu (right-click) to selectively enable or disable individual parameters or parameter groups, or to restore parameters to their default settings (Figure 4).
Figure 4. Selecting model parameters
Scope of contextual menus
The contextual menus shown in Figure 1 and Figure 4 can be applied at any point within their respective hierarchical displays. If you select an individual component or parameter, the effect will be limited to just that element. Applying a recording choice at an aggregate level propagates the effect to the selected element and all elements below it in the hierarchy.
Setting recording defaults
Choosing Recording Defaults... from the View Type pop-up menu on the Project Explorer toolbar opens a window where you can specify the parameters which should be recorded by default for each kind of component. See also Recording Manager defaults. Changes made in this window persist across invocations of Source.
Recording model outputs
When you run the models in a scenario, every node and link produces results in the form of predicted water flows, volumes and other data outputs.
Some node or link types can produce more than 20 separate data outputs (eg. storages). In general, the more outputs you record, the longer the simulation will take, though this depends on exactly what you record; recording mass-balance is more computationally intensive than recording inflow, for example.
When you save a project, or make a copy of a scenario, Source automatically saves the list of model outputs selected for recording. There are two ways to select which parameters and model elements to record:
- Using the Project Explorer, right-click a node, link or other element in the Project Hierarchy or a model parameter (Figure 4). From the pop-up menu, select:
- Record all: every parameter at this level and below will be recorded;
- Record none: no parameters at this level and below will be recorded;
If the indicator appears as ,
...
- this shows that some (not all) parameters at this level and below will be recorded.
- If you select a model element on the Geographic Editor or Schematic Editor (eg a catchment outlet), then the chosen model element is highlighted in the Project Hierarchy. Right-click the element name and select the recording status from the pop-up menu, or click the Record icon in the Project Explorer toolbar.
Using the Log Reporter
If a scenario run results in errors or warnings, the first indication of those is displayed in the Run completion dialog by a red or yellow icon next to the Close button as indicated in Figure 5.
Figure 5. Running scenario (error)
You can investigate the causes of errors or warnings using the Log reporter (Figure 6). If the Log Reporter window is not visible, do either or both of the following:
- Choose to make it visible; and
- Make the Log Reporter active by clicking the Log Reporter tab.
Once the Log Reporter is active,
...
you can view all the logs run by Source, from configuring a scenario to running it. To clear the log, right-click the Log Reporter window and choose
...
Clear from the contextual menu. To copy log contents to
...
a .csv file, right-click the Log Reporter window and choose
...
Export from the contextual menu. Table 1 shows what each of the columns stand for.
Figure 6. Log Reporter
...
Scenario results
Each scenario run creates a distinct collection of result sets. Each collection is represented by a tab in the Recording Manager. The name of each tab is formed by concatenating the name of the scenario with a time-stamp indicating when the scenario was run. For example, Figure 7 shows that "Scenario 1" has been run twice at slightly different times.
Figure 7. Recording Manager
You can use the tools on the Recording Manager toolbar to save a collection of results to a file, export a collection to Microsoft Excel, or delete the currently-selected collection.
Within each of the Recording Manager’s tabs, results are arranged in four columns:
- Type - Source generic name for node or link (eg Inflow);
- Name - your name for that component;
- Attribute - the name of the output parameter as listed in Parameters (eg Additional Inflow); and
- Values - a link which can be clicked to view a graphical representation of the output parameter.
You can navigate through a list of results using the vertical scroll bar. In addition, clicking on a link or node in the Schematic Editor ,Geographic Editor or Project Hierarchy automatically selects all of the result sets associated with that component in the Recording Manager.
Right clicking in the Recording Manager, then choosing Save Selected allows you to export the selected time series data as a .csv file. Choosing View Selected opens the Charting Tool for the selected time series data.
One of the key uses of the Recording Manager is to select one or more result sets (rows in the Recording Manager) for display in the Charting Tool. The Charting Tool helps you visualise, analyse and understand scenario results and other data produced by Source. Each time you click a link in the Values column, a copy of the Charting Tool opens to display that result set. Clicking the same link multiple times opens additional copies of the Charting Tool containing the same result set.
You can also use the Chart Recording Manager to view and manage result sets. Refer to Chart Recording Manager for more information.
Determining the flow sequence
You can find out how flow travels through the model by enabling the Flow Sequence model parameter prior to running the model. Click on Miscellaneous in the Project Hierarchy, which will populate the Parameters list with various attributes. Right click on Flow Sequence and choose Record All from the contextual menu. This attribute can be viewed in the Recording Manager and lists the nodes and links which describe the flow sequence (from the Flow Distribution Phase) in the model run. You can export this list using the Export button as shown in Figure 180.
Recording Manager, Flow Sequence
Incorporating uncertainty into climate variability
The Stochastic Analysis tool in Source is an abridged version of the Stochastic Climate Library (SCL) software available from the Catchment Modelling Toolkit web site, www.toolkit.net.au/scl. SCL is a stand-alone program containing several different stochastic models for climate data generation at various spatial and temporal scales.
The Source Stochastic Analysis tool currently contains a model for the generation of daily rainfall data for multiple sites using the transition probability matrix (with Boughton’s correction). Additional stochastic data generation models will be added to the Stochastic Analysis tool in the future. For a detailed description of the multi-site, daily rainfall generation model see Source Scientific Reference Guide.
Using the stochastic analysis tool
You must have an active scenario open in Source before you can use the Stochastic Analysis tool:
- In the Simulation toolbar, change the analysis option to Stochastic Analysis; and
- From the main toolbar, click Prepare to Run. The Stochastic Analysis window opens (Figure 181).
Stochastic analysis set up
- Define the Start and End years;
- Specify the number of replicates to run. The default is 20;
- Click OK; and
- In the Simulation toolbar, click Run. The Stochastic Analysis tool will automatically load the rainfall data that is being used by the scenario, and then stochastically generate rainfall replicates for each sub-catchment.
The Stochastic Analysis tool may take some time to complete, depending on the number of sub-catchments, replicates, number of recorded variables and type of rainfall data used in the scenario. Generally, the more complex the model or scenario, the longer the stochastic generation of rainfall data will be.
To produce valid results when comparing statistics from the generated and historical data, the replicate length and the historical input data length must be the same. To properly capture sampling variability, you should also generate at least 100 replicates. |
Once the Stochastic Analysis tool has finished, the modelled flow and constituent parameters appear in the Recording Manager and can be viewed by selecting the parameter of interest in the right-hand column of the Recording Manager.
A new screen appears with the stochastically generated flow and constituents replicates and statistical outputs (Figure 175).
All replicates are recorded and can be viewed by selecting a particular replicate, and this will be displayed as a time-series plot.
Viewing and assessing statistical results
A list of the possible Statistics is displayed in the top, middle window. To view a particular statistic, select one from the Statistics window. For example, the values of the statistic in the historical data, and the mean and percentiles of the statistic in the stochastically-generated data can be displayed as a box plot (Figure 183).
Figure 183. Box plot of mean monthly flow replicates
Limitations and cautionary notes
Although stochastic hydrology is a mature science, new stochastic models are continually being developed, usually with marginal improvements on previous models. The modelling approach for generating stochastic rainfall data has been selected because of available expertise, the model’s robustness, and extensive and successful model testing using data from across Australia.
A basic understanding of stochastic climate data is required to properly use stochastic data with hydrological and ecological models to quantify uncertainty in environmental systems associated with climate variability. The user should consider the following questions when designing a stochastic and hydrological modelling study: |
The Stochastic Analysis tool can take a long time to run, particularly when applied to large catchments and when you have specified many replicates (ie over 100). Such applications can take several hours to run. Therefore, when first designing a scenario with stochastically-generated rainfall data, keep the following in mind:
- Perform a "dummy" run with only a few replicates (< 20) to assess whether or not the stochastically-generated data is being generated properly;
- Be specific about what you need to record. If the flow that is coming out of the catchment outlet is of particular interest, then only record the catchment outflow when using the Stochastic Analysis tool. All other parameters and reporting options can be set to "Record None". This will reduce the repeat run time and reduce the size of the generated output data; and
- Make note of how many years of data you want to generate climate data for. Although it is desirable to use as much data as possible, only use what you need to get a satisfactory model result.
As a general rule, the input data should have at least 20 years of historical climate time-series data. |
...
The Tabular Editor provides a spreadsheet-like representation of data that is otherwise presented in graphical form in the Recording Manager. The editor only contains information after a warm-up or scenario run and is positioned to the first time-step in the forecast period. Figure 184 has been adjusted slightly to show both historical and forecast data. The row where the cells have a pale blue background is the first day of the forecast period (ie, normally "today"). Rows prior to this show historical data. At this point, all values in the forecast period are zero because no forecasting has been done. You can also override played values for various recorded parameters using the tabular editor. Simply click on the cell you wish to change, enter the required value and press Return on your keyboard.
Figure 184. Tabular Editor
Clicking the column title opens the Charting Tool for the node’s time series. This is synonymous to right clicking and choosing Time Series Graph from the contextual menu (Figure 184). Choosing Feature Editor opens the node’s feature editor that is associated with that column. Additionally, the contextual menu provides a means of changing the column’s units and access to a formatting editor for the individual column (see Customising the Tabular Editor).
Clicking a cell shows the relationship between nodes corrected for travel time. Figure 184 shows this relationship using a yellow highlight. When multiple cells are selected:
- The travel-time indicator is only calculated for the last cell that was clicked; and
- The selection statistics are updated to show the sum and mean for all cells in the selection.
The Show Column Editor button expands the window (Figure 184) to include an hierarchical list of data sources that are candidates for inclusion in the Tabular Editor. Click Hide Column Editor to return to the original view.
Customising the Tabular Editor
You can customise the Tabular Editor to your needs. For each type of node or link, you can select:
- A background colour for the cell;
- A foreground colour and stylistic variation (eg bold-face) for values displayed in the cell; and
- The number of decimal places to be displayed.
There are two ways to apply formatting:
- By adjusting a set of user preferences. See Tabular Editor formatting. Changes made via this method apply to all projects; or
- By right-clicking a column heading and choosing Column Formatting (refer to Column Formatting) . Changes made via this method only apply to the current project.
Column Formatting
In this window, the Multiple Expressions tab allows you to apply conditional formatting to cells in the tabular editor to highlight when thresholds or rules are breached eg. Flow < 500 ML/day. More than one expression can be applied to a cell. Click Add to specify the details of an expression, and Edit to define the expression using an Expression Editor. When more than one condition is satisfied, the cell is formatted as per the left hand side of the panel. Hover the mouse over the cell with the conditonal format, and the expression name is displayed. Click Remove to delete an expression from the list.
The Column Settings tab allows you to override project-related Tabular Editor Format Settings for the parameters displayed in the Tabular Editor.
...
Table 1. Log Reporter, Columns
Column | Description |
---|---|
Date | The local date on the computer. |
Run | The run number. You can also filter messages based on this number - use the filtering icon. |
Level | The type of message (similar to notes) - informational, warning or error. |
Time Step | The scenario time-step which the message refers to. |
Name | Name of the node or link corresponding to the message. |
Model Type | These are the node and link types – ie. Inflow, Straight Through Routing |
Message | Details of the message. |
Message Type | There are three types available:
|
Scenario results
Each scenario run creates a distinct collection of result sets. Each collection is represented by a tab in the Recording Manager. The name of each tab is formed by concatenating the name of the scenario with a time-stamp indicating when the scenario was run. For example, Figure 7 shows that "Scenario 1" has been run twice at slightly different times.
Figure 7. Recording Manager
You can use the tools on the Recording Manager toolbar to save a collection of results to a file, export a collection to Microsoft Excel, or delete the currently-selected collection.
Within each of the Recording Manager’s tabs, results are arranged in four columns:
- Type - Source generic name for node or link (eg Inflow);
- Name - your name for that component;
- Attribute - the name of the output parameter as listed in Parameters (eg Additional Inflow); and
- Values - a link which can be clicked to view a graphical representation of the output parameter.
You can navigate through a list of results using the vertical scroll bar. In addition, clicking on a link or node in the Schematic Editor, Geographic Editor or Project Hierarchy automatically selects all of the result sets associated with that component in the Recording Manager.
Right clicking in the Recording Manager, then choosing Save Selected allows you to export the selected time series data as a .csv file. Choosing View Selected opens the Charting Tool for the selected time series data.
One of the key uses of the Recording Manager is to select one or more result sets (rows in the Recording Manager) for display in the Charting Tool. The Charting Tool helps you visualise, analyse and understand scenario results and other data produced by Source. Each time you click a link in the Values column, a copy of the Charting Tool opens to display that result set. Clicking the same link multiple times opens additional copies of the Charting Tool containing the same result set.
You can also use the Chart Recording Manager to view and manage result sets. Refer to Chart Recording Manager for more information.
Determining the flow sequence
You can find out how flow travels through the model by enabling the Flow Sequence model parameter prior to running the model. Click on Miscellaneous in the Project Hierarchy, which will populate the Parameters list with various attributes. Right click on Flow Sequence and choose Record All from the contextual menu. This attribute can be viewed in the Recording Manager and lists the nodes and links which describe the flow sequence (from the Flow Distribution Phase) in the model run. You can export this list using the Export button as shown in Figure 8.
Figure 8. Recording manager, Flow sequence
Anchor | ||||
---|---|---|---|---|
|
The Tabular Editor only contains information after a warm-up or scenario run and is positioned to the first time-step in the forecast period. Figure 13 has been adjusted slightly to show both historical and forecast data. The row where the cells have a pale blue background is the first day of the forecast period (ie. normally “today”). Rows prior to this show historical data. At this point, all values in the forecast period are zero because no forecasting has been done.
Figure 13. Tabular Editor
Clicking the column title opens the Charting Tool for the node’s time series. This is synonymous to right clicking and choosing Time Series Graph from the contextual menu (Figure 13). Choosing Feature Editor opens the node’s feature editor that is associated with that column. Additionally, the contextual menu provides a means of changing the column’s units and access to a formatting editor for the individual column (see Customising the Tabular Editor).
Clicking a cell shows the relationship between nodes corrected for travel time. Figure 13 shows this relationship using a yellow highlight. When multiple cells are selected:
- The travel-time indicator is only calculated for the last cell that was clicked; and
- The selection statistics are updated to show the sum and mean for all cells in the selection.
The Show Column Editor button expands the window (Figure 13) to include an hierarchical list of data sources that are candidates for inclusion in the Tabular Editor. Click Hide Column Editor to return to the original view.
Using the Column Editor
The Show Column Editor tab displays a tree view of all the nodes used in the scenario, which you can expand to show the output parameters for each node. You can change the way results are displayed in the Tabular Editor, making analysis easier. You can:
- Check or uncheck items in the list to show or hide the relevant columns in the table.
- Re-order columns by clicking and dragging an item to the desired location in the list. For example, Figure
...
- 14 shows how re-ordering the parameters in the list results in a re-arrangement of table columns. In this case, the Downstream Flow for Storage 2 and Storage 4 appear together in the table after re-ordering them in the column editor.
Group similar parameters together using the group-related tabs. Click
...
on Add Group and enter an appropriate name for the group. Add the desired parameters, nodes or links by clicking and dragging them into the new group. An additional group (Downstream flow volume
...
for all inflows) has been added to the list
...
in Figure
...
15, along with the relevant parameters from each inflow node. This group can
...
be renamed (Edit Name) or removed (Del Group).
Figure 14. Show Column Editor (Column re-ordered)
Figure 15. Show Column Editor (Add group)
Anchor | ||||
---|---|---|---|---|
|
When constraints are enforced, there may be a difference between the amount of water ordered and that released. The application of constraints is evident at both the supply point and minimum flow requirement nodes.
To discover where constraints have been applied:
- Run the model;
- Select an appropriate supply point or minimum flow requirement node. This selects all of the node’s recording parameters in the Recording Manager; and
- Inspect the Values column in the Recording Manager and click an Order Details link. This opens a Complex Time Series Form (Figure
...
- 16). The Graph tab provides a summary of the differences between the amount ordered and the amount released for the duration of the run. The Constraints column of the Table tab (Figure
...
- 17) provides a breakdown per time-step. Hover your mouse cursor over a cell of interest to see its contents presented in a tool-tip.
Figure 16. Complex time series (Orders vs Releases, summary)
Figure 17. Complex time series (Orders vs Releases, detail)