Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Edit through the REST API
Info
iconfalse

This function is not available in Source (public version).

Introduction

Linear programming techniques assume that the data used is perfect. In particular, when activating these features, you are assuming that the objective function and constraint coefficients are correct, rather than the best estimates available. If this assumption does not hold, the solutions found may be sub-optimal.

...

Solvers use arc-node networks as their inputs. Source creates arc-node networks automatically for each time-step from the node-link network in the Schematic Editorthe Schematic Editor. There may be differences between the solution found by the solver ("as predicted") and flows as modelled during the flow phase ("as released"). The flow distribution phase resolves these differences by considering the ordering phase as having provided a minimum target to aim for. The optimum flow for each arc is determined by the netLP so that water will flow along the least cost pathway.

About costs

The solvers use a scheme of costs to determine optimal flows. Costs To choose network linear programming as the ordering algorithm, choose Edit » Scenario Options and select Ordering Algorithm. This opens the Ordering Algorithm section of Scenario Options (Figure 1). To configure netLP, choose Iterative solution to network linear program, this will make the rest of the display active and allow you to configure options for netLP.

Figure 1. Enabling ordering

Image Added

About costs

The solvers use a scheme of costs to determine optimal flows. Costs can range from -1.1E13 through to +1.1E13. The larger the cost, the greater the disincentive for water to flow along an arc. Conversely, the smaller the cost, the greater the incentive for water to flow along an arc. For example, in the above list of solver priorities, satisfying evaporative and transmission losses have the lowest cost, and therefore the highest incentive, in any model. The question of relative costs becomes relevant when defining cost functions for storages that are being operated in harmony.

...

  • RELAX-IV is generally faster than PPRN, particularly when PPRN is being run without side constraints. However, under certain circumstances, both PPRN without side constraints and RELAX-IV may become bogged down in excessive iteration;
  • PPRN supports side constraints. RELAX-IV does not*. If side constraints are crucial to the correct outcome, or to avoid sub-optimal solutions, or to control excess iteration, RELAX-IV can not be used; and
  • PPRN uses real numbers (at the precision of the underlying hardware) whereas RELAX-IV works with integers. Selecting the RELAX-IV algorithm implies integer conversion of the real numbers used internally by Source, during the optimisation process. Conversion implies rounding. Source scales values automatically before sending them to RELAX-IV to minimise loss of precision, and reconverts results returned by the solver to the proper range.

...

Info
iconfalse
Note: You should not change the solver algorithm once your model has been calibrated. Changing the solver algorithm will invalidate your calibration.

About side constraints*

Side constraints are implemented by translating between requirements set in various nodes and links in the Schematic Editor to the arcs and nodes used by the solver. In other words, you do not need to do anything to configure side constraints. Simply choosing PPRN with side constraints activates the necessary translations. For example, a Loss node creates an arc with high incentive that forces the solver to accept a particular loss.

...

  • Head versus outlet capacity relationships for storages, providing that the change in head across a single time-step does not also cause a change in the linear relationship (cross a control point in a piecewise linear function);
  • Flow dependencies that cause excess iteration; and
  • Circular constraints that prevent the solver from converging on an optimal solution.

Configuring optimisation

*side constraints have not yet been fully implemented and tested in Source

Anchor
ConfiguringOptimisation
ConfiguringOptimisation
Configuring optimisation

To configure optimised ordering, begin by choosing Edit » Ordering » Network Costs... or click Configure Ordering on the Ordering toolbar and choose Network Costs.... This opens the Network costs dialog (Figure 31).

Figure

...

1. Network costs (summary)

Image RemovedImage Added

Creating cost functions

...

The graph on the right hand side of Figure 31 provides a graphical representation of the selected storage cost. You can also simultaneously display several functions based on your selection of storage cost functions from the list on the left hand side. The lower the cost (Y-axis) the greater the incentive to retain, or carry-over the associated storage volume (X-axis) to the next time-step. The same information is presented in the table, and can be exported to a .CSV file if required.

...

Use the Storage Break Points tab (Figure 42) to design cost functions. Begin by using the Storage Cost Function popthe Storage Cost Function pop-up menu to select a cost function that you defined in the Cost Functions list in thethe Summary tab. Next, select the storage that should be associated with this cost function.

Figure
4
2. Network Costs (Storage Break Points)

Image RemovedImage Added

Note
Although you can define storage breakpoints for storage A in terms of storage B, you should avoid doing so because it can lead to infeasible solutions.

By default, Source provides four rows in the Break points table. Each row is associated with a percentage of the full supply storage volume, which is visible, and a cost, which is not visible. In the Break pointsBreak points table shown in Figure 42:

  • The bottom-most 10% of the capacity of the storage is associated with a base cost of -11000.00;
  • The next 40% (50%-10%) of the capacity of the storage has a cost of the base cost plus one unit of increment. Here, the increment is 10, so the cost will be -10990;
  • The next 30% (80%-50%) of the capacity of the storage has a cost of -10980 (base plus two increments); and
  • The remaining capacity of the storage has a cost of the base plus three increments: -10970.

A more formal specification of the cost calculation is:

Equation 1

...

Image Added

Recall that negative costs are incentives. Accordingly, in this table, the greatest incentive is to retain any water in the bottom-most 10% of the capacity of the storage (for carry-over to the next time-step), followed by the water in the next 40% of the capacity of the storage. By interleaving base costs and increment values, releases from multiple storages can be controlled quite precisely to maintain a desired balance.

...

Table 1. Storage breakpoints (data file format)
RowColumn (comma-separated)
12
1Carry over numberActive storage (%)
2..nnpoint

where:

n is an integer in the range 1..n representing the carry-over number.

point is the storage percentage (eg. “10” for 10%) when carry-over arc n takes effect.

...

Table 2. Storage cost functions (example)
Storage Carryover ArcStorage 1Storage 2
Base Cost-11000Base Cost-11001
Increment2Increment2
Storage %Arc CostStorage %Arc Cost
15.6-110007.4–11001
211.1-1099814.8–10999
316.7–1099622.2–10997
422.2–1099429.6–10995
527.8–1099237.0–10993
633.3–1099044.4–10991
738.9–1098851.9–10989
844.4–1098659.3–10987
950.0–1098466.7–10985
10100.0–10982100.0–10983

The result of the design intention is shown in Figure 53. Note that, in the absence of any inflows that replenish the storages, the X-axis can also be interpreted as expressing time.

Figure
5
3. Carryover Arc Costs vs Storage Volume

Image RemovedImage Added

Applying cost functions

You apply cost functions in the Storage Targets tab (Figure 64). Each storage in your model is represented by a row in this table. The remaining columns contain pop-up menus where you can connect an appropriate cost function to a selected storage for a particular month.

Figure
6
4. Network costs (Storage targets)

Image RemovedImage Added

You can also import storage targets from a .CSV file. The format of the file is shown in Table 3. Note that the column ordering in the .CSV file does not match the display in Figure 64.

Table 3. Storage targets (data file format)
Row
Column (comma-separated)
 
 
12..13
1Storagemonth
2..nsnamecname

Where

month is the first three characters of the month of the year (eg “Feb”)

...

You can specify the number of shortfall arcs that are generated for each of the demand nodes using the Number of Shortfall Arcs drop down menu (Figure 75). The default number is 4.

Figure

...

5. Network

...

 costs (Demand

...

priorities)

Image RemovedImage Added

You can control the order in which shortfalls are satisfied. The Priority column in Figure 75 shows which demand component of the model has will receive water via its shortfall arcs.

...

Table 4. Demand priorities (data file format)
RowColumn (comma-separated)
123
1DemandPriorityComputation Sequence
2..nsnamepriseq

Wherewhere:

sname is the name of the supply point

...

Table 5. Shortfall arc costs (example)
ScenarioSupply pointPriorityComputation sequenceShortfall arcSatisfaction order
NumberCost
A1111110000022
2110000044
3110000066
4110000088
2121110000011
2110000033
3110000055
4110000077
B1121110000011
2110000033
3110000055
4110000077
2111110000022
2110000044
3110000066
4110000088
C1211110000011
2110000022
3110000033
4110000044
2111110000055
2110000066
3110000077
4110000088

NetLP ordering at nodes

In Source, networks are composed of arcs which have maximum capacities and costs associated with them. These costs can either be positive (disincentive) or negative (incentive). The optimum flow for each arc is determined by the netLP so that water will flow along the least cost pathway.

Storage node

While the minimum and maximum order times have to be calculated upstream of each relevant node to the relevant storages, the system also has to calculate the downstream order time which is the timeframe time frame over which the node must forecast the downstream orders for in advance.

Info
iconfalse
Note: In a netLP system, refer to Operating targets when setting up a storage node.

Controlled splitter node

For the splitter node, in the netLP order phase, the main stream has two parallel arcs - a forced flow arc and the natural flow arc. The capacity of the forced flow arc in the mainstream is the opposing flow volume of the maximum effluent flow. The maximum effluent flow is dependant on the inflow to the controlled splitter node. The effluent side of the controlled splitter also has a forced and a natural flow arc, with the capacity of the forced flow arc the minimum volume of flow down the effluent side.

...

To ensure that the above are met, you can configure each of the branches with a cost incentive. In a maximum flow constraint node that is immediately below the controlled splitter on one side of the stream, this will ensure that the flow rules are met. The maximum flow constraint should be configured with parallel arcs with either a cost for flowing water down the effluent or a cost incentive for flowing water down the main stream. The cost should be small, to ensure that the overall cost structure of the network is not impacted too much. Figure 12 shows shows an example of this.

Inspecting an arc-node network (simple)

It is possible to inspect textual representations of the arc-node networks that are generated by Source for processing by the solver. The steps are:

  • Select the active scenario in the Project Hierarchy (Project Explorer);
  • Locate the Arc-Node Network entry in the Model Parameters list (also Project Explorer) and enable it for recording;
  • Run the scenario; and
  • In the Values column of the Recording Manager (Complex time series, summary), locate and open View Multiple Supply Path Setup. The window will be similar to Figure 9.

Figure 9 is a work in process so most of the labels are inaccurate. The graph provides a measure of computational complexity (iterations to solve) at each time-step. Note that the peaks are clipped to the value of the Maximum Iterations parameter in Figure 1.

Figure 9. Inspecting the generated arc-node model

Image Removed

...

Info
iconfalse
Note: Ensure that the forecast supply is greater than the total order size. If this is not the case, the following error message will occur at the first node that this occurs at: Forecast supply greater than total order size in interpretation of network LP. Try checking inflow forecasts at inflow nodes, and that all confluence inputs are defined to be regulated.

Troubleshooting It is possible to visualise the arc-node networks that are generated by Source using third party software. For more information please see: Troubleshooting and Debugging