Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

...

...

...

...

...

...

...

...

...

...

...

 

Excerpt

Regression Test Report including coverage (index.html): 3.8.19beta Regression test report.zip 

Regression test repository changes since the first Source 3.8.18beta:
(error)  2 Projects get inconsistent results
(warning) 3 Project results changed
(warning) 7 Projects edited
(info) 14 Projects edited for performance options
(plus) 12 Projects added

...

 

Revision  838  -> 897

ChangeJIRA Issue / ReasonRegression test
(warning) Projects edited

Continuous accounting projects gave inconsistent results in 3.8.18beta with the change to run Water user ordering in parallel.

This will be made into an option in 3.8.19beta so users can disable the feature.

Jira Legacy
serverJIRA
serverIdc4ca6e0f-9f42-3d1a-879c-870abe699ab1
keyRM-15103

A number of the Continuous Accounting projects that includes:

Accounting\Continuous Accounting\CA109
Accounting\Continuous Accounting\CA12orderdebit
Accounting\Continuous Accounting\CA8orderdebit
Accounting\Continuous Accounting\CA9

(info) Projects edited for performance optionsPerformance projects have been edited to take advantage of available options

Catchments\All_node_link_types
Catchments\Cattai
Catchments\CBM_base
Catchments\Nattai_00
Community Projects\CSIRO_Flinders
Community Projects\Namoi
Community Projects\NM42
Community Projects\Paroo
Community Projects\Risk Use Case
Community Projects\River Murray
Community Projects\Victorian Allocation Final Report
General\NewerNodes
Nodes\Loss\LossNode
Wetland\WetlandTest

(error) Inconsistent results

(warning) Results changed

Jira Legacy
serverJIRA
serverIdc4ca6e0f-9f42-3d1a-879c-870abe699ab1
keyRM-14872
Updating for changes in results

Jira Legacy
serverJIRA
serverIdc4ca6e0f-9f42-3d1a-879c-870abe699ab1
keyRM-15261
We are sill working on the issue.

Results vary between machines and we are still trying to track down exactly why and what to do about it.

Community Projects\NM42
Nodes\Water User\SR_NM63

(warning) Projects edited

(warning) Results changed


Rebuilt Wetlands test suite

Developers\Wetlands\WetlandSimpleTestSuite\Wetland Test Suite

(plus) Projects AddedProjects moved from the Automated GUI testing repository

Developers\PerformanceTests\Gilbert - IQQM
Developers\PerformanceTests\Goulburn Operations Model
Developers\PerformanceTests\Katherine River Sub-catchment
Developers\PerformanceTests\Mekong
Developers\PerformanceTests\NM64
Developers\PerformanceTests\Stung Chinit
Developers\PerformanceTests\Wetland

Developers\MemoryTests\Catchments
Developers\MemoryTests\Complete
Developers\MemoryTests\DoraTest
Developers\MemoryTests\ScenarioTransfer
Developers\MemoryTests\SC_Cattai

 

 


Projects currently ignored:

NameDescription
River Murray Performance Test.rsprojConcerned about performance rather than results
stochastic_analysis.rsproj
waiting on
Jira Legacy
serverJIRA
serverIdc4ca6e0f-9f42-3d1a-879c-870abe699ab1
keyRM-14842
to be implemented
Risk Use Case.rsprojignored until a more appropriate test is built