4.2.8 Regression Test Changes

Owned by Geoff Davis
Last updated: 13 Oct 2023 by Rohan ThomasVersion comment

Regression Test Report including coverage (index.html): 4.2.8beta regression test matrix

Regression test repository changes since the first Source 4.2.7beta:

(warning) 18 Projects results changed
(warning) 11 Projects edited
(info) Project names and result headers edited
(plus)(error) 2 Project recently added - not yet passing


LFS beta branch:  4.2.7beta (53c986260ff93c449be73773529f09d17e9da5bb) → 4.2.8beta (713581883c2992b3fc870cba396f4eb2127be52c)

ChangeJIRA Issue / ReasonRegression test
(warning) 2 Project Results changed

RM-16684 - Getting issue details... STATUS

Community Projects/Daily GBCL - Goulburn System
Community Projects/GBCL_daily

(warning) 8 Project Results changed

RM-16571 - Getting issue details... STATUS

Ownership\SupplyPointOwnership
Ownership\Ordering+Ownership+StorageRouting
Developers\PerformanceTests\Gilbert - IQQM
Community Projects\NM42
Community Projects\NM42_BackwardEuler
Nodes\Water User\SR_NM63
Ownership\trade demo-error

(warning) 3 Project Results changed

RM-16694 - Getting issue details... STATUS

Community Projects/CSIRO_Flinders
Community Projects/Gilbert
Community Projects/Onka1

(warning) 3 Project Results changed

RM-16594 - Getting issue details... STATUS

Hydropower
Hydropower_2valves
SF3E_Hydropower

(warning) 2 Project Results changed

RM-16762 - Getting issue details... STATUS - was also included in a second release of 4.2.7beta

Developers\PerformanceTests\Gilbert - IQQM
Nodes\Water User\SR_NM63
(warning) 1 Project Edited

Updated Runoff_to_DS_end_of_link database to fix missing table.

Catchments\Runoff_to_DS_end_of_link
(warning) 3 Projects Edited

Updated MDBA Projects to account for Entititlement -> Entitlement change.

Community Projects\MDBAAssessment
Community Projects\River Murray Performance Test 2
Community Projects\River Murray Performance Test 2 BE
(warning) 7 Projects Edited

RM-16625 - Getting issue details... STATUS Updated WaterFeatureType to Weir

Community Projects/GBCL_daily
Community Projects/River Murray
Developers/MemoryTests/Complete
Nodes/Weir/WeirTests
Training_Files/River_Operator/OperationsI
Training_Files/Weir_Solution
Wetland/WetlandTest/Wetland Scenario 1/Single analysis

(info) Project names and result headers edited

A number of project file names were shortened and the scenario names were edited to remove white space.


Accounting\Annual Accounting\Yong's test case\Carryover_100%Max_CarryOver_GoulburnSWA →
Accounting\Annual Accounting\Yong's test case\Carryover_100%_GoulburnSWA

Accounting\Annual Accounting\Yong's test case\Carryover_unlimited_200%Max_Carryover_GourlburnSWA →
Accounting\Annual Accounting\Yong's test case\Carryover_200%_GourlburnSWA

White space removed from scenario name:
Nodes\PipeJunction
Catchments\Rainfall Runoff\ObsSurfRunoff_RR
NetLP\MSP_CS4D_monthly

(plus)(error) 2 Project recently added - not yet passing

We are currently working on this project the plugins

Community Projects\River Murray Performance Test 2
Community Projects\River Murray Performance Test 2 BE

Ignored Tests

NameDescription
stochastic_analysis.rsproj
waiting on RM-14842 - Getting issue details... STATUS to be implemented
Risk Use Case.rsprojignored until a more appropriate test is built
MW_DS_15

Disabled in Performance Tests because Dynamic_SedNet Plugin is popping up a user interface in the run: RM-16460 - Getting issue details... STATUS