3.8.19 Regression Test Changes

Regression Test Report including coverage (index.html): 3.8.19beta Regression test report.zip

Regression test repository changes since the first Source 3.8.18beta:
2 Projects get inconsistent results
3 Project results changed
7 Projects edited
14 Projects edited for performance options
12 Projects added

Revision 838 -> 897

Change	JIRA Issue / Reason	Regression test
Projects edited	Continuous accounting projects gave inconsistent results in 3.8.18beta with the change to run Water user ordering in parallel. This will be made into an option in 3.8.19beta so users can disable the feature. RM-15103 - Getting issue details... STATUS	A number of the Continuous Accounting projects that includes: Accounting\Continuous Accounting\CA109 Accounting\Continuous Accounting\CA12orderdebit Accounting\Continuous Accounting\CA8orderdebit Accounting\Continuous Accounting\CA9
Projects edited for performance options	Performance projects have been edited to take advantage of available options	Catchments\All_node_link_types Catchments\Cattai Catchments\CBM_base Catchments\Nattai_00 Community Projects\CSIRO_Flinders Community Projects\Namoi Community Projects\NM42 Community Projects\Paroo Community Projects\Risk Use Case Community Projects\River Murray Community Projects\Victorian Allocation Final Report General\NewerNodes Nodes\Loss\LossNode Wetland\WetlandTest
Inconsistent results Results changed	RM-14872 - Getting issue details... STATUS Updating for changes in results RM-15261 - Getting issue details... STATUS We are sill working on the issue. Results vary between machines and we are still trying to track down exactly why and what to do about it.	Community Projects\NM42 Nodes\Water User\SR_NM63
Projects edited Results changed	Rebuilt Wetlands test suite	Developers\Wetlands\WetlandSimpleTestSuite\Wetland Test Suite
Projects Added	Projects moved from the Automated GUI testing repository	Developers\PerformanceTests\Gilbert - IQQM Developers\PerformanceTests\Goulburn Operations Model Developers\PerformanceTests\Katherine River Sub-catchment Developers\PerformanceTests\Mekong Developers\PerformanceTests\NM64 Developers\PerformanceTests\Stung Chinit Developers\PerformanceTests\Wetland Developers\MemoryTests\Catchments Developers\MemoryTests\Complete Developers\MemoryTests\DoraTest Developers\MemoryTests\ScenarioTransfer Developers\MemoryTests\SC_Cattai

Projects currently ignored:

Name	Description
River Murray Performance Test.rsproj	Concerned about performance rather than results
stochastic_analysis.rsproj	waiting on RM-14842 - Getting issue details... STATUS to be implemented
Risk Use Case.rsproj	ignored until a more appropriate test is built