Versions Compared

Old Version 2

changes.mady.by.user Geoff Davis

Saved on

compared with

New Version Current

changes.mady.by.user Rohan Thomas

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Repair Jira Macros
Excerpt

Regression Test Report including coverage (index.html): 3.8.19beta Regression test report.zip 

Regression test repository changes since the first Source 3.8.18beta:
(error)  2 Projects get inconsistent results
(warning) 3 Project results changed
(warning) 7 Projects edited
(info) 14 Projects edited for performance options
(plus) 12 Projects added 

Revision  838  -> 897

ChangeJIRA Issue / ReasonRegression test
(warning) Projects edited

Continuous accounting projects gave inconsistent results in 3.8.18beta with the change to run Water user ordering in parallel.

This will be made into an option in 3.8.19beta so users can disable the feature.

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-15103

A number of the Continuous Accounting projects that includes:

Accounting\Continuous Accounting\CA109
Accounting\Continuous Accounting\CA12orderdebit
Accounting\Continuous Accounting\CA8orderdebit
Accounting\Continuous Accounting\CA9

(info) Projects edited for performance optionsPerformance projects have been edited to take advantage of available options

Catchments\All_node_link_types
Catchments\Cattai
Catchments\CBM_base
Catchments\Nattai_00
Community Projects\CSIRO_Flinders
Community Projects\Namoi
Community Projects\NM42
Community Projects\Paroo
Community Projects\Risk Use Case
Community Projects\River Murray
Community Projects\Victorian Allocation Final Report
General\NewerNodes
Nodes\Loss\LossNode
Wetland\WetlandTest

(error) Inconsistent results

(warning) Results changed

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-14872
Updating for changes in results

Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-15261
We are sill working on the issue.

Results vary between machines and we are still trying to track down exactly why and what to do about it.

Community Projects\NM42
Nodes\Water User\SR_NM63

(warning) Projects edited

(warning) Results changed


Rebuilt Wetlands test suite

Developers\Wetlands\WetlandSimpleTestSuite\Wetland Test Suite

(plus) Projects AddedProjects moved from the Automated GUI testing repository

Developers\PerformanceTests\Gilbert - IQQM
Developers\PerformanceTests\Goulburn Operations Model
Developers\PerformanceTests\Katherine River Sub-catchment
Developers\PerformanceTests\Mekong
Developers\PerformanceTests\NM64
Developers\PerformanceTests\Stung Chinit
Developers\PerformanceTests\Wetland

Developers\MemoryTests\Catchments
Developers\MemoryTests\Complete
Developers\MemoryTests\DoraTest
Developers\MemoryTests\ScenarioTransfer
Developers\MemoryTests\SC_Cattai


Projects currently ignored:

NameDescription
River Murray Performance Test.rsprojConcerned about performance rather than results
stochastic_analysis.rsproj
waiting on
Jira Legacy
serverSystem JIRA
serverIdc4ca6e0fa22b5711-9f422728-3d1a3bcc-879c860f-870abe699ab12832d905a432
keyRM-14842
to be implemented
Risk Use Case.rsprojignored until a more appropriate test is built