4.12.0 Regression Test Changes

Owned by Geoff Davis
Last updated: 13 Oct 2023 by Rohan ThomasVersion comment

Regression test report: 4.12.0 Regression Test Report.zip

Tests Changed

Regression test repository changes since the first Source 4.11.0:

(warning) 05 Project results updated


LFS beta branch:  4.11.0rtc  (d74f42e82ab96148577f05e8fc3647d19dfd7331)  → 4.12.0betartc (15b85c5517b26d99e05ff2bcf9c7f8485f8c608e)

ChangeJIRA Issue / ReasonRegression test
(warning) 8 Projects updated

RM-18771 - Getting issue details... STATUS

The existing 'Ordering Phase' time of evaluation that is used for Functions and Modelled Variables has been split into:

  • 'Water User & Constraint Phase'
  • 'Ordering Phase'.

Migration code has been used to decide which evaluation time is appropriate for a Function/Variable to get the same results. However, there are some complex cases that could not be catered for and this has caused result changes.

Operations/MurrayOps
Community Projects/River Murray Performance Test 2
Community Projects/River Murray Performance Test 2 BE
Community Projects/River Murray Model 2019.11.14 One Year
Community Projects/River Murray Model 2019.11.14 Fifty Year
Community Projects/Daily GBCL - Goulburn System
Community Projects/GBCL_daily
Community Projects/Source GBCL Model

Ignored Tests

NameDescription

Community Projects/River Murray Model v982 - One Year

Community Projects/River Murray Model v982 - Fifty Year

Did not run due to conflict with MDBA plugins

stochastic_analysis.rsproj

Waiting on RM-14842 - Get regression test builder / runner to work for Stochastic Analysis results NEEDS TRIAGE to be implemented

Risk Use Case.rsprojignored until a more appropriate test is built
PerfRunTimeoutFailure.rsprojPerformance test only