4.6.2 Regression Test Changes

Regression test report: 4.6.2 Regression Test Report

A number of changes have impacted the regression tests including moving weir recorders, changes to Off Allocation, and improving the stability of results.

Regression test repository changes since the first Source 4.6.1beta:

6 Projects and results updated
51 Projects with recorder changes
5 Project regression test configuration modified
1 Regression Test Added

LFS beta branch: 4.6.1beta (1c697c1d28115c661e03d9166628e5bc3272d1c0) → 4.6.2beta (dbd9fb0ce7da094b32f2716f59ea8c045055e261)

Change	JIRA Issue / Reason	Regression test
2 Projects and results updated	RM-17675 - Getting issue details... STATUS RM-17933 - Getting issue details... STATUS	Community Projects/River Murray Performance Test 2 BE Community Projects/River Murray Performance Test 2
5 Projects with result changes	RM-17704 - Getting issue details... STATUS	Community Projects/NM42 Community Projects/NM42_BackwardEuler Community Projects/NM75 Community Projects/River Murray Performance Test 2 Community Projects/River Murray Performance Test 2 BE
1 Project configuration changed	RM-17956 - Getting issue details... STATUS	Plugins/SubSourceSingleProject
5 Project regression test configuration modified	RM-17524 - Getting issue details... STATUS	Developers/PerformanceTests/Delete Nodes Developers/PerformanceTests/Goulburn Operations Model Training_Files/River_Operator/OperationsB Training_Files/River_Operator/OperationsC Training_Files/River_Operator/OperationsH
5 Projects with result name changes	RM-17802 - Getting issue details... STATUS Renamed recorders	General/AWRA-R_v2/Template model Catchments/Tutorial3/Default scenario Environmental Flow Manager/Two spells with manager Environmental Flow Manager/One spell with manager Nodes/Environmental Flow/EFN limit to reference flow
7 Projects edited to reduce the assurance rule to a warning	RM-17607 - Getting issue details... STATUS Reduced status in regression tests	Accounting/Continuous Accounting/CA1 Community Projects/Daily GBCL - Goulburn System Community Projects/MDBAAssessment Community Projects/NM42 Community Projects/NM42_BackwardEuler Community Projects/Source GBCL Model Developers/MemoryTests/Complete
2 Projects and results updated	RM-17697 - Getting issue details... STATUS	Community Projects/River Murray Performance Test 2 BE Community Projects/River Murray Performance Test 2
1 Projects and results updated	RM-17942 - Getting issue details... STATUS	Constituent \ Min volume - Lumped
46 Projects with recorder changes	RM-16811 - Getting issue details... STATUS	Accounting\Annual Accounting\TradeCalibration Accounting\Continuous Accounting\CA1 Accounting\Continuous Accounting\CA1_2storages Accounting\Continuous Accounting\CA1_Init Accounting\Continuous Accounting\CA10 Accounting\Continuous Accounting\CA11b Accounting\Continuous Accounting\CA15 Accounting\Continuous Accounting\CA17 Accounting\Continuous Accounting\CA1deadstorage Accounting\Continuous Accounting\CA1lowAW Accounting\Continuous Accounting\CA6 Accounting\Continuous Accounting\CA7 Accounting\Triggers\Truncate Community Projects\BorderRivers Community Projects\Daily GBCL - Goulburn System Community Projects\GBCL_daily Community Projects\MDBAAssessment Community Projects\Namoi Community Projects\NM42 Community Projects\NM42_BackwardEuler Community Projects\NM75 Community Projects\River Murray Performance Test 2 BE Community Projects\River Murray Performance Test 2 Community Projects\River Murray Performance Test Community Projects\Source GBCL Model Developers\MemoryTests\Complete Environmental Flow Manager\One spell with manager Environmental Flow Manager\Two spells with manager Nodes\Environmental Flow\EFN limit to reference flow Nodes\Environmental Flow\EFN residual requirement Nodes\Environmental Flow\EFN time in spells Nodes\Water User\Crop Mod\CM11 Nodes\Water User\Crop Mod\CM12b Nodes\Water User\Crop Mod\CM23 Nodes\Water User\Crop Mod\CM24 Nodes\Water User\Crop Mod\CM25 Nodes\Water User\Crop Mod\CM26 Nodes\Water User\Crop Mod\CM27 Nodes\Water User\Crop Mod\CM35 Nodes\Water User\SR_NM63 Nodes\Water User\WU12d Nodes\Water User\WU4p Nodes\Water User\WU4q Plugins\SubSourceSingleProject Training_Files\ExpEdCycDem Training_Files\Water_User_Introduction
1 Regression Test Added	RM-18007 - Getting issue details... STATUS

Ignored Tests

Name	Description
stochastic_analysis.rsproj	Waiting on RM-14842 - Getting issue details... STATUS to be implemented
Risk Use Case.rsproj	ignored until a more appropriate test is built
PerfRunTimeoutFailure.rsproj	Performance test only