Versions Compared

Old Version 2

changes.mady.by.user Geoff Davis

Saved on

compared with

New Version Current

changes.mady.by.user Rohan Thomas

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Repair Jira Macros

Regression test report: 4.6.2 Regression Test Report

...

Excerpt

A number of changes have impacted the regression tests including moving weir recorders, changes to Off Allocation, and improving the stability of results.

Regression test repository changes since the first Source 4.6.1beta:

(warning) 6 Projects and results updated
(info) 51 Projects with recorder changes
(info) 5 Project regression test configuration modified
(plus) 1 Regression Test Added


LFS beta branch:  4.6.1beta (1c697c1d28115c661e03d9166628e5bc3272d1c0) → 4.6.2beta (dbd9fb0ce7da094b32f2716f59ea8c045055e261)

ChangeJIRA Issue / ReasonRegression test
(warning) 2 Projects and results updated

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-17675

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-17933

Community Projects/River Murray Performance Test 2 BE
Community Projects/River Murray Performance Test 2

(warning) 5 Projects with result changes

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-17704

Community Projects/NM42
Community Projects/NM42_BackwardEuler
Community Projects/NM75
Community Projects/River Murray Performance Test 2
Community Projects/River Murray Performance Test 2 BE
(info) 1 Project configuration changed

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-17956

Plugins/SubSourceSingleProject
(info) 5 Project regression test configuration modified

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-17524

Developers/PerformanceTests/Delete Nodes
Developers/PerformanceTests/Goulburn Operations Model
Training_Files/River_Operator/OperationsB
Training_Files/River_Operator/OperationsC
Training_Files/River_Operator/OperationsH

(info) 5 Projects with result name changes

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-17802

Renamed recorders

General/AWRA-R_v2/Template model
Catchments/Tutorial3/Default scenario
Environmental Flow Manager/Two spells with manager
Environmental Flow Manager/One spell with manager
Nodes/Environmental Flow/EFN limit to reference flow
(warning) 7 Projects edited to reduce the assurance rule to a warning

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-17607

Reduced status in regression tests

Accounting/Continuous Accounting/CA1
Community Projects/Daily GBCL - Goulburn System
Community Projects/MDBAAssessment
Community Projects/NM42
Community Projects/NM42_BackwardEuler
Community Projects/Source GBCL Model
Developers/MemoryTests/Complete
(warning) 2 Projects and results updated

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-17697

Community Projects/River Murray Performance Test 2 BE
Community Projects/River Murray Performance Test 2

(warning) 1 Projects and results updated


Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-17942

Constituent \ Min volume - Lumped

(info) 46 Projects with recorder changes

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-16811

Accounting\Annual Accounting\TradeCalibration
Accounting\Continuous Accounting\CA1
Accounting\Continuous Accounting\CA1_2storages
Accounting\Continuous Accounting\CA1_Init
Accounting\Continuous Accounting\CA10
Accounting\Continuous Accounting\CA11b
Accounting\Continuous Accounting\CA15
Accounting\Continuous Accounting\CA17
Accounting\Continuous Accounting\CA1deadstorage
Accounting\Continuous Accounting\CA1lowAW
Accounting\Continuous Accounting\CA6
Accounting\Continuous Accounting\CA7
Accounting\Triggers\Truncate
Community Projects\BorderRivers
Community Projects\Daily GBCL - Goulburn System
Community Projects\GBCL_daily
Community Projects\MDBAAssessment
Community Projects\Namoi
Community Projects\NM42
Community Projects\NM42_BackwardEuler
Community Projects\NM75
Community Projects\River Murray Performance Test 2 BE
Community Projects\River Murray Performance Test 2
Community Projects\River Murray Performance Test
Community Projects\Source GBCL Model
Developers\MemoryTests\Complete
Environmental Flow Manager\One spell with manager
Environmental Flow Manager\Two spells with manager
Nodes\Environmental Flow\EFN limit to reference flow
Nodes\Environmental Flow\EFN residual requirement
Nodes\Environmental Flow\EFN time in spells
Nodes\Water User\Crop Mod\CM11
Nodes\Water User\Crop Mod\CM12b
Nodes\Water User\Crop Mod\CM23
Nodes\Water User\Crop Mod\CM24
Nodes\Water User\Crop Mod\CM25
Nodes\Water User\Crop Mod\CM26
Nodes\Water User\Crop Mod\CM27
Nodes\Water User\Crop Mod\CM35
Nodes\Water User\SR_NM63
Nodes\Water User\WU12d
Nodes\Water User\WU4p
Nodes\Water User\WU4q
Plugins\SubSourceSingleProject
Training_Files\ExpEdCycDem
Training_Files\Water_User_Introduction

(plus) 1 Regression Test Added

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-18007


Ignored Tests

NameDescription
stochastic_analysis.rsproj

Waiting on

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-14842
to be implemented

Risk Use Case.rsprojignored until a more appropriate test is built
PerfRunTimeoutFailure.rsprojPerformance test only