Introduction
Insight is eWater’s multiple-objective optimisation decision support framework. This framework allows for more efficient evaluation of planning options than the traditional manual trial and error approach that is often used. In other words, the main aim of Insight is to optimise decision rules for multiple objectives. The The framework allows optimisation across single or multiple scenarios. The optimisation tool enables a more thorough examination of potential planning scenarios and the resulting trade-offs between desired outcomes.
...
Mathematically known as objective functions, these can contain multiple parts, such as measure of cost, a measure of environmental impact and a measure of social costs. Examples of objective functions might include: minimising the operating cost of the system, minimising environmental impacts, or minimising time spent in water restrictions. In In Insight, objective funcitons must be expressed as minimisation problems. Maximisation Maximisation problems can be optimised by expressing the objective function as a negative.
...
The decision variables and objectives must be defined in the Source project as functions. Insight can then run the Source model thousands of times, setting different values for the decision variable expressions and evaluating the corresponding objectives for every individual run.
This means that in order for a Source parameter to be included in an optimisation problem, that parameter needs to be defined using the Function manager in Source.
...
Launching Insight
...
When you open Insight for the first time, you may be prompted to point Insight to the location of the Source command line tool (RiverSystem.CommandLine.exe).
Figure 1 shows the user interface for Insight, which allows you to load Source projects, configure a settings file and perform an optimisation run.
The File menu items allow you to work with settings and results as follows:
- File » Load Settings - Load settings that were previously configured and saved (optional);
- File » Save Settings - Saves the current run settings;
- File » Load results - Loads the results of a previously saved optimisation run (optional);
- File » Save results - Save the results of the current optimisation run; and
- File » Exit - Quits Insight.
Figure 1. Insight user interface
| Info |
|---|
Note: Prior to using Insight, ensure that all Source projects contain only one scenario. |
Setting up an optimisation run/Creating a settings file
...
Figure 1 shows how to launch Insight once Source has been installed:
- Click on the Windows Start menu;
- Choose All Programs (shown on the left of Figure 1);
- Scroll down and click on the folder indicating the version of Source you have installed (In Figure 1, this is eWater Source 3.3.0.234); and
- Choose Insight from the list of programs listed (shown on the right of Figure 1).
Figure 1. Launching Insight
Using the Insight interface
When you open Insight for the first time, you may be prompted to point Insight to the location of the Source command line tool (RiverSystem.CommandLine.exe).
Figure 2 shows the user interface for Insight, which allows you to load Source projects, configure a settings file and perform an optimisation run.
The File menu items allow you to work with settings and results as follows:
- File » Load Settings - Load settings that were previously configured and saved (optional);
- File » Save Settings - Saves the current run settings;
- File » Load results - Loads the results of a previously saved optimisation run (optional);
- File » Save results - Save the results of the current optimisation run; and
- File » Exit - Quits Insight.
Figure 2. Insight user interface
| Info |
|---|
Note: Prior to using Insight, ensure that all Source projects contain only one scenario. |
Setting up an optimisation run/Creating a settings file
- Open Insight and click Browse (as shown in Figure 2) to choose the directory containing the project(s). Projects can also be in subdirectories below the directory pointed to;
- Click Load to populate the left panel with all the available functions defined in the loaded projects;
- For each of the panels on the right, use the appropriate button to add or remove objectives functions or decision variables from the main function list to the individual panel. For example, click Add objective » to add an objective function to the Objectives panel. Moreover, to move a discrete decision variable back to the main list of objective functions, click « Remove discrete decision variable.
- In the Objectives panel, the Multi-project Aggregation Method drop-down menu allows you to choose how you want to aggregate process the individual time-step resultsobjective function values passed from individual scenarios. By default Insight uses the final value of the specified function as the value of the objective function for each scenario. The Aggregate over full timeseries checkbox allows you to choose how to setup the objectives. If enabled, the objective needs to be set up so that all values of the global expression are used use the values of the objective function determined at each timestep, rather than just the last value (via the selected statistical function) to give the objective value. If not, the last value of the global expression gives the objective value. You . You can also remove an objective from the Objectives panel by choosing it from the list and clicking « Remove objective. This will move the objective back to the main objectives list.
- Choose the number of generations and the population size of each generation. These parameters define how many simulation runs are performed by the optimiser. The required values will depend on the complexity of the optimisation project. If the number of runs is too small, the optimiser will not be given sufficient time to search for the multi-objective optimal set of results. The population size also sets the maximum number of points on the Pareto front or surface.
- Specify whether to run the optimisation on your local machine (enable the Run Source optimisation locally radio button), or across server endpoints (using the Run Source optimisation on endpoints radio button). Server endpoints allow you to run the optimisation across several machines simultaneously. Load the endpoints settings file by clicking Load Endpoints and point Insight to the appropriate file. If running Source optimisation on a local machine, set the number of cores to use with the Local server limit scroll button. The number of cores to use depends on the machine you will are using.
- Save your settings using File » Save Settings. This creates a settings file, which can be used later.
| Info | ||
|---|---|---|
| ||
| Note: The difference between Objectives and tracked variables are that the former are optimised, whereas the latter are not. Tracked variables are a set of secondary objectives that may affect decision-making, but do not get optimised within Insight. |
The optimisation is now ready to be run.
...
Insight can be configured, set up (to create using a settings file) and run using the command line as well. This link shows some examples of how to use the command line for Insight. Note that an explanation of these commands is provided further down:
...
| Information required | Example |
|---|---|
| Location of the Source project file | project C:\Insight\test\Example_project.rsproj |
| List of the objectives, using the global expressions in the Source project | OutputExportedOutput $reliabilityNegOutput ExportedOutput $unitcostOutputExportedOutput $Yieldneg |
| List of decision variables, using the global expressions in the Source project, along with their constraint | real $pipecapacity 0 200 |
...
During the optimisation run (when using the interface), after more than a generation is complete, you will be able to view the hypervolume plot – an indication of how the Pareto Front (selection of optimal results) is convergingis converging. The hypervolume provides an indication of the convergence of the model results towards the Pareto Front. The hypervolume is calculated based on the distance between a maximum non-optimal solution and the modelled results. In effect, the larger the hypervolume, the closer the results are towards reaching the Pareto optimal solution. The hypervolume provides an indication of the convergence of the model results towards the Pareto Front. The hypervolume It is calculated based on the distance between a maximum non-optimal solution and the modelled results. In effect, the larger the hypervolume, the closer the results are towards reaching the Pareto optimal solution. The hypervolume provides an indication of the convergence of the model results towards the Pareto Front. It is calculated based on the distance between a
Insight provides two plots of hypervolume when using the user interface (shown in Figure 3). The blue hypervolume plot is calculated whilst Insight is running, without knowing what the maximum non-optimal solution is (shown on the left of Figure 2). The red hypervolume plot is calculated at the end of the optimisation run, using the maximum non-optimal solution and the modelled results. In effect, the larger the hypervolume, the closer the results are towards reaching the Pareto optimal solution.
Insight provides two plots of hypervolume when using the user interface (shown in Figure 2). The blue hypervolume plot is calculated whilst Insight is running, without knowing what the maximum non-optimal solution is (shown on the left of Figure 2). The red hypervolume plot is calculated at the end of the optimisation run, using the maximum non-optimal solution as reference. The hypervolume is a useful indication of how much the optimal solutions are changing – if the hypervolume plot is flattening out, this is a sign that more generations are unlikely to produce more optimal results.
Figure 2. Insight results, hypervolume plots
2D graph
Click the 2D Graph tab at the top of the Results dialog to view two-dimensional scatterplots of the results (as shown in Figure 3). The drop-down menus for the x and y axes list all the objectives specified in the optimisation. To view the graph for a particular relationship, choose the relevant items from the drop-down menus and click Plot. The example shown in Figure 3 has three objectives defined: $reliabilityNeg, $unitcost and $Yieldneg. The points on the graph are forming the Pareto Front for this optimisation.
The Filter Properties dialog allows you to view the results in a specified range:
- Choose the type of plot (scattered or pareto) in the Plot Option drop-down menu;
- In the Selected Filter drop-down menu, choose the filter and click Edit Filter;
- This opens the Edit Filter dialog (shown in Figure 4) showing the entire range of values.
- You can change the filter's name using the Filter Title panel.
- Edit any value by double clicking on the cell you wish to change and enter the required value (in the Lower Filter or Upper Filter columns); and
- Click OK to save changes close the Edit Filter dialog or Cancel to quit without saving.
Figure 3. Insight results, 2D graph
Figure 4. Insight results, Filter properties
3D graph
Click the 3D Graph tab to view a three-dimensional plot of the computed optimised solutions (shown in Figure 5). Just as with the two-dimensional graph, the individual solutions form a Pareto Front. The x, y and z-axes represent the objectives that were specified in the project. These can be changed using their corresponding drop down menus in the Configure panel on the left. Click Plot to change the axes; Reset to revert it back to its original state, and Save to save the results of the 3D graph to a file.
Additionally, you can filter the graph view to a specified range using the Filter Properties dialog (as shown in Figure 4) under the Plot Option drop-down menu.
...
as reference. The hypervolume is a useful indication of how much the optimal solutions are changing – if the hypervolume plot is flattening out, this is a sign that more generations are unlikely to produce more optimal results.
Figure 3. Insight results, hypervolume plots
2D graph
Click the 2D Graph tab at the top of the Results dialog to view two-dimensional scatterplots of the results (as shown in Figure 4). The drop-down menus for the x and y axes list all the objectives specified in the optimisation. To view the graph for a particular relationship, choose the relevant items from the drop-down menus and click Plot. The example shown in Figure 4 has three objectives defined: $reliabilityNeg, $unitcost and $Yieldneg. The points on the graph are forming the Pareto Front for this optimisation.
The Filter Properties dialog allows you to view the results in a specified range:
- Choose the type of plot (scattered or pareto) in the Plot Option drop-down menu;
- In the Selected Filter drop-down menu, choose the filter and click Edit Filter;
- This opens the Edit Filter dialog (shown in Figure 4) showing the entire range of values.
- You can change the filter's name using the Filter Title panel.
- Edit any value by double clicking on the cell you wish to change and enter the required value (in the Lower Filter or Upper Filter columns); and
- Click OK to save changes close the Edit Filter dialog or Cancel to quit without saving.
Figure 4. Insight results, 2D graph
Figure 5. Insight results, Filter properties
3D graph
Click the 3D Graph tab to view a three-dimensional plot of the computed optimised solutions (shown in Figure 6). Just as with the two-dimensional graph, the individual solutions form a Pareto Front. The x, y and z-axes represent the objectives that were specified in the project. These can be changed using their corresponding drop down menus in the Configure panel on the left. Click Plot to change the axes; Reset to revert it back to its original state, and Save to save the results of the 3D graph to a file.
Additionally, you can filter the graph view to a specified range using the Filter Properties dialog (as shown in Figure 5) under the Plot Option drop-down menu.
You can also rotate the three-dimensional graph to make the results more meaningful, visually.:
- Press the Ctrl key on your keyboard and hold it down for the duration of the exercise;
- Right-click on the 3-D graph once;
- Right-click again and hold down the mouse button; and
- Move the mouse to rotate the entire graph.
Figure 6. Insight results, 3D graph
Spider graph
The third tab in the Results dialog shows the optimised results in a spider graph (as shown in Figure 67). You can use the Filter feature (as described previously) to view a filtered spider graph of the results.
Figure
...
7. Insight results, spider graph
Table
The final tab in the Results dialog shows all the results of the optimisation in a table. Figure 7 8 shows an example of the table, with all optimised solutions for each objective and decision variable specified in Insight. Note that the green arrow on the right allows you to save the decision variable to the Source project.
Figure
...